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PREFACE 


New mental test methods of demonstrated validity are 
always welcome, and this is especially true just now of 
those which are relatively independent of the language 
factor. Other things being equal, any psychologist 
prefers to rate the intelligence of his subjects by what 
they can do rather than by what they say. Very often 
the “‘other things” are not equal, and the test which 
uses language possesses certain advantages that are not 
to be lightly set aside. The carefully worked out per- 
formance test, however, has a wide field of usefulness, as 
all who have engaged in clinical work will readily admit. 
The need for such tests has never been adequately met, 
largely because really valid ones are much more difficult 
to devise than is the case with tests which utilize lan- 
guage. In the upper ranges of intelligence, especially, 
most performance tests have but little differentiating 
value, simply because they do not draw heavily enough 
upon the higher mental processes. In the Block-design 
test, Dr. Kohs has largely overcome this difficulty, and 
has given us an intelligence scale which is certain to 
prove extremely useful. His success, we believe, is the 
direct result of his thoroughgoing appreciation of the 
real nature of the mental processes involved in what we 
call intelligence. 

Lewis M. TERMAN. 


INTRODUCTION 


“What is the nature of mind?” This question, pro- 
pounded when man first became conscious of himself, 
still remains but inadequately answered. Nevertheless, 
some evident progress has been made. ‘The light of 
scientific progress is gradually penetrating the various 
nooks and recesses of our mental life, and the machinery 
of thought, although dimly revealed, is becoming more 
apparent in its operation. This monograph is but a mere 
fragment, explaining little if anything regarding the 
dynamics of mental process, yet it hopes to place a 
variety of perplexing problems in a new perspective. 
We shall have occasion, for example, to examine some 
current definitions of intelligence, and we shall indicate 
wherein our research into the value and significance of 
completion and combination tests forces us to a recon- 
sideration of the criteria of intelligence and to a restate- 
ment and a redefining of some fundamental principles. 
By mentioning in this connection the great importance 
of the ‘‘analytic-synthetic” tendency characteristic of 
all mental behavior, from the simplest sensory, ideational, 
and affective states to the most complex, we are really 
anticipating a later discussion of these matters. Suffice 
it to say that psychology has not yet interpreted our 
mental constructs in terms of a synthetic principle, 
although our philosophers have already blazed a some- 


what ambiguous trail. 
ix 


x INTRODUCTION 


It has often been urged that the position of neutrality 
is one full of danger for its claimant. Although this may 
be adjudged a “behaviorist” study, nevertheless full 
weight has been given to those contributions of “‘struc- 
turalists”’ and ‘‘functionalists”’ which have thrown light 
upon our particular problem. The psychological family 
is at discord unless each member is willing, not alone to 
see the others’ point of view with tolerance, but to accept 
at its real value any scientific contribution no matter 
what the standpoint of the experimenter. This is no 
apology for the present study — the remarks are intended 
merely to emphasize our community of problems, and 
the possibility that each school of method may throw 
some light on all of them. We are all confronted with 
the question, ‘‘What is the nature of mind?” Knowing 
the futility of any complete reply, we have accustomed 
ourselves either to ignore the question or to maneuver 
a Freudian “escape from reality” by losing ourselves in 
metaphysical speculation. If this piece of work yields 
but a little toward an additional understanding of this 
baffling problem our efforts will, indeed, be well rewarded. 
S. C. Kons. 
Portland, Oregon, 

August 30, 1921 
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PART A 


THE PSYCHOLOGY OF ANALYSIS 
AND SYNTHESIS 


THE PSYCHOLOGY OF ANALYSIS AND 
SYNTHESIS 


The Place of Synthetic and Analytic Functioning in 
Psychic Activity 


I. PHILOSOPHICAL ORIENTATION 


THE psychology of combinative or completive ability 
leads us back through the early history of psychology to 
the time when philosophers psychologized and psycholo- 
gists philosophized. The limited confines of our study 
compel brevity, and we need go back no farther than 
the ‘‘associationist”’ school. 

Hobbes, a staunch materialist, the contemporary of 
Bacon, Descartes, and Galileo, may rightly be called the 
father of “associational” psychology. Hobbes ‘“‘mate- 
rialized” mental activity. Psychic behavior was inter- 
preted as mental physics or chemistry. All knowledge 
arises through sensations, which, combined in certain 
definite forms, yield the various complex mental pro- 
cesses. Conscious states are due to the refined move- 
ments of mental atoms controlled by the laws of asso- 
ciation, the foundation-stones of mental functioning. 
Words are nothing but mere symbols, markers. It is 
their combination, their addition, their subtraction, 


which yields thought. 
3 


4 INTELLIGENCE MEASUREMENT 


The legitimate successor of Bacon and Hobbes was 
John Locke. From a psychological point of view, it 
may be of interest to note that his ‘Essay on the Human 
Understanding” grew out of his attempt to answer the 
question: ‘‘What is the nature of sensations?” He 
began by asserting that there are no “innate ideas,” 
in opposition to the position of Descartes and to the 
later views of Spinoza and Leibniz. At the beginning, 
mind is a “white piece of paper,’ upon which impres- 
sions are marked. Ultimately “nothing is in the intel- 
lect that has not been first in the sense.”’ But the mind 
is not a passive receptacle. It can manipulate and com- 
bine ideas. These ideas are derivates of “‘simple ideas” 
out of which the more complex have been compounded. 
This compounding is explainable in terms of the laws 
of association. 

Hume, an outstanding sensationalist, maintained that 
no ideas existed which were not derived from impressions, 
a position to which many of our present-day psycholo- 
gists would claim adherence. Impressions are of two 
kinds: sensational (outer) and affective (inner). And 
ideas are copies or echoes of these simple elemental 
states. Much of his psychology is devoted to a discus- 
sion of the compounding or the combination of ideas, 
and this to such a degree, that his whole psychology be- 
comes warped in its exaggeration of the actual part 
played by associational processes. The differences be- 
tween conception, memory, imagination, judgment, and 
so on, are largely differences in the forms by means of 
which ideas combine. All mental behavior is just asso- 
ciation between ideas. Ideas possess “forces” or “de- 
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terminations” which tend to bring and keep them 
together. The individual then is helpless, since these 
“forces” follow fixed, mechanical laws. 

Leaving the “associationists,” we find Kant, among 
philosophers, giving perhaps the clearest exposition of 
the hierarchies of mental functioning, progressing 
through hierarchies of mental “synthesis.” 

Kant, perhaps, has dealt more extensively with ‘“men- 
tal synthesis” than any other single philosopher. His 
task as a philosopher was largely epistemological. His 
metaphysical structure, although promised, never ap- 
peared complete. It remained for others, Fichte, Hegel, 
Schelling, Herbart, and Schopenhauer, to take the step 
beyond. Kant was interested in the processes which give 
us knowledge. He postulated a threefold world: one, 
of subjective states (inner consciousness), another of 
phenomena (knowledge), and another of absolute reality 
(Ding-an-Sich). The first realm each individual can 
alone experience, the last no one can experience, the 
second, however, is common property and can be intel- 
ligently discussed by all of us. To Kant, subjective 
states are synthetic products, different in every one of 
us. And in each of his three books which compose his 
“Critique of Pure Reason” he discusses the different 
levels of synthetic activity: (@) in perception, (6) in 
understanding, (c) in reason. In his search for the pro- 
cesses which yield knowledge, he concluded that the im- 
portant factor was the synthetic power of mind. In this 
sense mental functioning is dynamic. If one can imagine 
an individual who lacks this synthetic power, the ticking 
of a clock would be nothing more than tock, tock, tock. 
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To those, however, who do possess it, the clock’s 
ticking is perceived as one, two, three, etc. The 
experience is cumulative, each item including its prede- 
cessors. 

Kant very clearly differentiated between mental end- 
results and synthesis—one a product, the other a 
process. Synthesis is not subject to volitional vicissi- 
tudes, but is a heritage common to all. It is for that 
reason that we can agree upon such matters as physical 
laws, time-estimates, standards, and so on. Racial 
differences in thought and knowledge are differences 
largely of synthetic potentiality. Groups, therefore, 
may misunderstand each other because of this basic 
difference, since differences in synthetic power will lead 
to differences in thought and behavior. “The world is 
my representation,” says Kant. Knowledge is a com- 
bination of sensations or ideas, “‘a unification of the 
manifold.” And the expression of knowledge is through 
the judgment, which may be analytic or synthetic. Kant 
discusses quite extensively the distinction between the 
two types, but there is no need of our following his 
argument farther. 

Few, if any, of the terms we use to express our thoughts 
come to us as an immutable, unchanged, and unchange- 
able heritage. Although we continue using the same 
terms, these take on changing meanings with the changes 
in our notions regarding the character of the individual 
and of the cosmos. Therefore, although we shall fre- 
quently utilize the terms “analysis” and “synthesis” 
throughout this monograph, they are not to be construed 
other than as here defined. 
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1. By “synthesis” we mean, on the one hand, the 
intensity of that fundamental force or condition innate 
in nervous protoplasm which binds neurons into complex 
systems, and, on the other hand, the capacity of a living 
organism to construct out of mental elements and frag- 
mentary experiences, concepts and notions of a higher 
order. The fuller elaboration of these statements is left 
for the succeeding paragraphs. j 

2. By “analysis” we mean the capacity for observing 
or discovering parts or differences in objects or qualities 
which for themselves seem unitary. 

3. Although one can only speculate on these matters, 
it seems reasonable that analysis and synthesis are but 
the head and tail of a single function-tendency. This 
“‘analytic-synthetic”’ activity may be regarded a funda- 
mental property characteristic of all irritable tissue, and 
more markedly so of nervous tissue. All forms and 
degrees of this function-tendency seem possible, from 
the simplest to the most complex. 


2. PSYCHOLOGICAL ORIENTATION 


If one thumb through the average psychology for a 
description and an analysis of the mental process of 
synthesization, integration, fusion, discrimination, differ- 
entiation, comparison, combination, blending, assimila- 
tion, and analysis, one’s search will prove rather barren. 
Yet, as we shall have occasion to observe in greater 
detail later, these processes appear most fundamental 
for normal mental development. 

The elements or primary structures of consciousness 
escape our observation. What we experience, what we 
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observe when we introspect, are fused or synthesized 
products of these elements. It has been said with justice 
that ‘‘Whoever would understand the facts of experience 
must know how they are built up out of the combination 
of elements.’! Take mental functioning anywhere along 
the line, from the simplest type of perception to the most 
complex higher thought process, and at every point evi- 
dences of synthetic activity are observable or may safely 
be postulated. Percepts are synthesized sensations, 
ideas are synthesized percepts, images are recalled traces 
of these synthesized products, codrdinations are orderly 
combinations of reflexes, judgments are orderly combina- 
tions of ideas, reasoning results from an orderly combina- 
tion of judgments — emotion, will, learning, habit, all 
are combinations of some elementary form of mental 
process, these conscious states becoming more complex 
with the increase in complexity of the integrative 
pattern. 

“Consciousness is not a shower of shot,’? a mass of 
disconnected elementary states, but at every stage it 
consists of a fusion of elementary processes into those 
more complex, and these finally into a functional unity. 
Psychology may well be defined as the science devoted 
to a study of mental elements, sensations, images, and 
affections, and the manner, condition, laws, concomitants, 
and effects of their combination at different develop- 
mental levels, phylogenetic and ontogenetic, normal 
and abnormal. This is a task alike for the structuralist, 


1 Judd, 13; 28. All references are to the bibliography at the end of 
Part A, 
2 Royce, 24; 108. 
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the behaviorist, the functionalist. It cannot be pre- 
empted by one, nor completely dealt with except by all. 

At the bottom of this conception of mental elaboration 
is an implication which approaches the speculative. We 
cannot, however, on that account escape the force of 
its bearing on a reasonable explanation of observed con- 
ditions. In chemistry and physics the phenomenon of 
crystallization is thoroughly familiar. Given a fluid 
containing the proper ingredients, under certain condi- 
tions crystallization will take place. The canons of 
science justify our inquiry into the “how” but not the 
“why.” Nevertheless, the postulation of a force or of 
forces, closely bound up perhaps with the atoms or the 
molecules, acting concertedly under fixed law and 
resulting in a new product, is a postulation which few 
will attempt to deny scientific scrutiny. So, too, in 
considering the mechanics of mental elaboration, to 
postulate a fundamental force or forces making for higher 
degrees of mental organization and for varieties of higher 
thought forms need not be considered irrelevant. The 
fundamental “ability” to “synthesize” or “combine” 
is not one which we may “‘will” to possess or not. We 
“‘synthesize”’ entirely independent of our personal choice 
in the matter. Just as we can exercise little if any control 
on the hyperfunction or hypofunction of some of the 
other organs of the body — for example, the kidney, the 
thyroid, the intestines—so also is our interference 
with brain function nominal. It seems evident that if 
one is born with good mental endowment his brain will 
“synthesize” to a degree and in a manner impossible to 
one whose native mental endowment is poor. Of course, 
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it is left, more or less, to individual initiative to exercise 
this inherited endowment efficiently. And yet, tests 
of “completion” or “combination” may measure this 
“synthesizing ability” in a very rough fashion, quite 
independent of schooling or other formalized training. 
Differences in level of mental ability may some day be 
explained, among other things, on the basis of differences 
in fundamental synthesizing ability, or the capacity of 
the nervous system to fuse elementary states of conscious- 
ness into higher thought forms. And perhaps the dif- 
ferences between a superior intelligence and a deficient 
intelligence may be found largely due to differences in 
this original basic synthesizing capacity. 
Hobhouse has stated: 


“Where there is mind there is order and system, corre- 
lation and proportion, a harmonising of forces, an inter- 
connection of parts. The organism which is gifted with 
intelligence shows it by arranging its actions on a certain 
plan. It adapts means to ends, which is one sort of 
correlation, and in so doing it perhaps brings a past 
experience to bear, interpreting a perception, for exam- 
ple, by memory; and this is another sort of correlation.’”! 


Wherever we find traces of mental functioning there we 
inevitably observe the organization and correlation of 
mental elements into hierarchies. And this organization 
of mind on any functional level is evidenced by a parallel 
organization of behavior. In general, it might be stated 
that organized action is a product of intelligence, un- 
organized action the result of the absence or non-use of 
intelligence. And throughout the realm of mental func- 


1 Hobhouse, 10; 6. 


PSYCHOLOGICAL ORIENTATION 11 


tioning we note rather clearly the tendency for the fusion 
of elemental, conscious states into more complex forms, 
forms which serve more readily for individual adapta- 
tion to environmental demands. 


“Our assimilations have not merely to do with the 
processes of perception and memory: they appear on the 
highest level of the intellectual life. All our thinking 
involves assimilation. When a novel object puzzles us, 
or when a problem baffles us, that is because we have not 
yet learned to assimilate the new experience to our former 
fashions of conduct. But when our puzzle is thought- 
fully satisfied, this occurs because we have learned to 
assimilate the new facts to the old principles, i.e., to adjust 
our former methods of conduct, with a minimum of 
change, to the new situation. When the problem is 
solved, that is because what baffled us about a question 
which was asked, but to which we could not respond, 
disappears, because we have assimilated the matter at 
issue by remembering from our former experience an 
answer that serves the purpose. To be sure, such assimi- 
lation may be accompanied with alterations of habits 
that will need to be considered later under the head of 
Mental Initiative. But every thoughtful process is, in at 
least one respect, a process of assimilation.” 1 


In what manner is this concept of a synthesizing, or 
an assimilative, or combinative, or integrative principle 
different from our earlier and now discarded view that 
“associations of ideas” serve as a complete explanation 
of the varieties of mental experience? Our present hy- 
pothesis is rather one which assumes nervous tissue to 
possess the property or tendency of becoming integrated 
into higher units of complexity, as well as the tendency 


1 Royce, 24; 245. 
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for organizing environmental stimuli which appeal to 
various sense modalities into a consistent, understand- 
able, and assimilable unity. The “association of ideas” 
is perhaps the most obvious superficial result of this 
synthetic-analytic tendency. It should be kept in mind, 
however, that “associations” evidence the result and 
not the process of this fundamental integrative force. 
The process is inherent in nervous tissue, and the result 
is present in consciousness as “associations between 
ideas.” Titchener admirably summarizes the situation 
in seven words: “The brain associates, and meanings 
are associated.” ! ss 

In general, it may be said that “the entire process of 


elaborating . . . objects of perception by the senses, 
presupposes for its explanation a constant activity of 
the mind . . . in combining the sensations into ever 


more complex forms. This combining activity is best 
called ‘synthetic,’ or ‘constructive.’””? Nevertheless, there 
is an analyzing activity of mind which apparently is as 
important as the synthesizing. And perhaps analysis 
and synthesis are merely two aspects of nerve cell 
mechanism. Although antonyms, and expressing oppo- 
site tendencies, analysis and synthesis show evidences 
of each reénforcing and aiding the other. 

Our aim is not to make hair-splitting distinctions be- 
tween the processes of synthesis, assimilation, blending, 
combination, completion, induction, fusion, on the one 
hand, and analysis, comparison, deduction, differentia- 
tion, discrimination, on the other. It is sufficient to 


1Titchener, 29; 149. 
2 Ladd and Woodworth, 14; 384. 


PSYCHOLOGICAL ORIENTATION 13 


state that the process or processes to which these terms 
refer are fundamental and may represent innate, dynamic 
potentialities characteristic of all nervous tissue. Many 
have attempted to differentiate the analytic activity 
from the synthetic. Our immediate purpose, however, 
will not necessitate any other assumption than that 
brain substance fundamentally manifests this activity 
— analysis and synthesis. Whether there are different 
“types”! is irrelevant to the present discussion. It 
perhaps is true, however, that at different age levels 
the character of the analyses and syntheses is different, 
the processes themselves changing as one passes through 
infancy to childhood, to adolescence, to adulthood, and 
finally through senescence. 

Thorndike remarks that “the intellectual life of man 
seems to consist as much in discriminating, abstracting, 
taking apart, as in associating or connecting.”? Al- 
though “fusion of some kind is always present in expe- 
rience,’’? nevertheless, the other aspect cannot be over- 
looked: 


‘Closely allied to the fact of focalness of thinking is 
the fact of analysis, the fact of breaking up a total fact 
into its elements, parts, or aspects. It is only as a result 
of such a process of breaking up total facts into their 
qualities that the elements of color, size, shape, weight, 
pressure, and the like are felt, in place of a ‘big, blooming, 
buzzing confusion.’ It is only as a result of such a 
process that many feelings of meanings and of intellectual 
relationships arise at all.’ 


1 Meumann, 17. 3 Judd (1st ed.), 13; 137. 
2 Thorndike, 27; 35 4 Thorndike, 28; 105. 
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James clearly and with due emphasis maintains: 
“After discrimination, association!”! In speaking of 
these two processes, he says: 


“Tt is obvious that the advance of our knowledge 
must consist of both operations; for objects at first 
appearing as wholes are analyzed into parts, and objects 
appearing separately are brought together and appear 
as new compound wholes to the mind. Analysis and 
synthesis are thus the incessantly alternating mental 
activities, a stroke of the one preparing the way for a 
stroke of the other, much as, in walking, a man’s two 
legs are alternately brought into use, both being indis- 
pensable for any orderly advance.” ? 


Hobhouse expresses a somewhat similar idea: 


“Analysis rests on comparison, which is an act of 
synthesis, since it brings different experiences into rela- 
tion; and gains in explicitness, pari passu with the com- 
mon character on which the comparison turns. And not 
only does the concept rest on a synthesis, but its essen- 
tial function is to make a further synthesis possible . . . 
There is thus in the free usage of detached concepts a 
synthetic process always at work articulating what has 
been disarticulated by analysis.” * 


The process of comparison stands out clearly in many 
writings and experiments as perhaps the most important 
feature of the analyzing procedure. 


“By deliberate comparison I mean a mental confront- 
ing of the two objects, and a transition of attention from 
the one to the other, so as to discover some respect in 
which similar things differ in spite of their similarity, or 
in which different things agree in spite of their diversity, 


1 James, 11; 550. _? James, 11; 550. 8 Hobhouse, 10; 294. 
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and also a fixing of the precise nature of this agreement 
or difference.””! 


Stout has so ably described this activity of “com- 
paring” that this lengthy quotation may be pardoned: 


“Comparison in all but a most rudimentary form is an 
ideational activity. Even when the objects compared 
are both present to the senses, each is scrutinised in 
turn. For anything more than a vague awareness of 
resemblance or difference, it is necessary to keep before 
the mind the ideal representation of the one object in 
the very act of examining the other. Only in this way 
can each detail and characteristic in turn be selected for 
comparison, so as to distinguish the points of difference 
from the points of agreement. Hence we may attribute 
the absence of comparison in animals in all but its most 
vague and rudimentary form, to the absence or extremely 
imperfect development of ideational activity in general. 

“When the process of deliberate comparison plays an 
important part in the mental life, it involves a corre- 
sponding development in conceptual thinking, in the dis- 
tinction of the general or universal from the particular. 
To compare is always to compare in some special respect. 
Some theoretical or practical end is to be subserved by 
the comparison. The difference or agreement to be dis- 
covered is not any difference or agreement, but one which 
has significance for the guidance of conduct or for the 
solution of a theoretical difficulty. Thus comparison 
takes place only in regard to the characteristics which 
happen to be interesting at the moment, other character- 
istics being disregarded or set aside as unimportant. 
Objects in other ways most diverse may yet in a certain 
respect be compared and found more or less similar, and 
objects in other ways most similar may be compared in 
a certain respect and found more or less unlike.’’? 


1Stout, 26; 452. 2 Stout, 26; 455-456. 
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It may be of interest to recall at this point that Binet, 
with his unusually clear insight into the problems related 
to the development of intelligence, realized that the 
observation of the ways in which two things are alike 
is of as great a diagnostic value in determining intelli- 
gence level as the observation of ways in which two things 
are different. For that reason he devised tests for the 
purpose of determining a child’s capacity to note simi- 
larities as well as differences. Terman, recognizing the 
importance of both processes, has included tests which 
measure both capacities in his revision and extension 
of the Binet scale. These tests, however, deal with 
concrete objects. Additional tests might be devised 
to measure the ability to note differences, using abstract 
material. Thus, 


“To note the fall of an apple is to analyze out a com- 
paratively obvious feature; to distinguish falling as a 
feature of the moon’s revolution about the earth is still 
analysis, proceeding in much the same manner, but deal- 
ing with more difficult material and working with much 
more refined and elaborate tools.” ! 


That there are individual differences in ability to 
compare and in ability to note similarities and differences 
seems obvious. According to James: 


“Some people are far more sensitive to resemblances 
and far more ready to point out wherein they consist, 
than others are. They are the wits, the poets, the in- 
ventors, the scientific men, the practical geniuses. A 
native talent for perceiving analogies is reckoned by 
Professor Bain (‘Study of Character,’ p. 317) and by 


1 Ladd and Woodworth, 14; 606-607. 
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others before and after him, as the leading fact in genius 
of every order.” ! 


The extent to which two things which are compared 
may appear different, may run from one extreme to the 
other. Two occurrences or things or facts may be so 
strikingly different that discrimination is relatively easy. 
On the other hand, the difference in the detail of the two 
objects under inspection may be so fine as to escape the 
notice of all but the most mature or the most expert. 


“We all cease analyzing the world at some point, and 
notice no more differences. The last units with which 
we stop are our objective elements of being. Those of a 
dog are different from those of a Humboldt; those of a 
practical man from those of a metaphysician. . . . And 
when the omitted things are discovered and the unnoticed 
things are laid bare, it is not that the old thoughts split 
up, but that new thoughts supersede them, which make 
new judgments about the same objective world.” ? 


A phenomenon closely linked with the matters men- 
tioned above, and of considerable significance for mental 
progress, is that to which Mach has called attention,’ 
namely, the inborn nature of experimentation in man — 
not the organized, thoroughly planned experimentation 
of the scientist, but the searching and the testing, the 
manipulating and the trying so characteristic of any 
normally developing child. 

An item of great relevancy at this point is the question 
of individual differences in this experimenting attitude, 
the differences in the character of the observations 
(analyses), and the differences in the final syntheses. 


1 James, 11; 53¢. 2 James, 11; 489. 3 Mach, 15; 180. 
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Let us assume two children observing an object for the 
first time, one of superior and one of inferior mental 
ability. The little objective data which we now possess 
tend to show that the later imagery of this experience is 
markedly different in the two. The initial attitude is 
different. The observational procedure is different: the 
analyzing, the comparing, the selecting, the assimilating 
processes are different. “This selective activity not 
only differs from individual to individual, but even in 
the same individual it varies with the progress of his 
development and of his knowledge.” It is evident, 
therefore, that the final syntheses or products of observa- 
tion will be different in the two. Many students of the 
graphic functions have frequently pointed out the devel- 
opment of a child’s ability in drawing through distinct 
stages. Thus, the first phase is that of purposeless draw- 
ing —a mere scribbling for scribbling’s sake; details, 
if observed at all, are detached entities, synthesis 
appearing only in its crudest form. Then follows a 
second stage, in which the child attempts a reproduction 
of objects seen, but synthetic incapacity is evident 
through inability to evaluate properly and place the 
numerous details into a reasonable whole. Thus, in 
drawing a picture of a human being the head is of enor- 
mous proportions, the limbs being appended from the 
chin, while other important parts of the body are omitted. 
In the final stage keenness of perception, a well-developed 
capacity for discrimination of detail, a knowledge and an 
experience of the laws of perspective, harmony, and 
balance, together with rigid self-criticism, are operative. 


1 Meumann, 16; 10, 11. 
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These steps in the development of mental ability are 
more or less duplicated in any variety of specific fields. 
For example, an average child of three can do no more 
than merely enumerate objects in a picture: the rela- 
tionships between objects are not perceived. At seven, 
however, he can observe that the details bear some rela- 
tion to one another and that some activity is portrayed. 
Only relationships of an obvious sort are observed. 
While at twelve, not only does he observe certain activi- 
ties, but he obtains something more than is directly 
presented: he reads an interpretation into the picture, 
and perceives the subtle meanings underlying a given 
situation. Each higher stage requires a higher degree of 
mental synthesis, of combinative power. So, again, the 
same is true of ability to copy a circle, a square, a dia- 
mond, and a design. Each one of these figures seems to 
require a higher form of analytic-synthetic ability for 
successful performance. It is in this respect that the 
feeble-minded are characteristically defective. The con- 
summation of associations or synthesizations of higher 
order, especially if of an abstract nature, are very difficult 
if not impossible for them. 

Meumann summarizes the differences observable in 
children of different age levels in this capacity to elabo- 
rate and assimilate their worldly experiences.1 He 
distinguishes three levels. On the first, synthesis is most 
predominant. Each object is cognized as a unit, its 
detail being distinguished separately in but a very inade- 
quate fashion. A true analytic tendency is not yet 
observable. Whatever meager characteristics are noted 


1 Meumann, 17; 116 ff. 
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by the child are combined into a most illusory and 
fantastic notion. It is this stage which Meumann 
designates as the ‘‘Imaginative-Synthetic Period.” This 
stage ends at about the age of eight or nine. Then fol- 
lows a period which is characterized by a pronounced 
tendency toward analysis. The parts, peculiarities, and 
relationships of things are more attentively observed. 
The child develops a more truthful, a more accurate 
knowledge of objects. Imaginative combinations, elab- 
orations, and interpretations become far less frequent. 
At about adolescence another period follows which is 
again synthetic, but of distinctly different character. 
The trend now is toward logical, reasonable combinations 
of impressions characteristic of the adult. ‘In that first 
period the child lives as in a fairy-world, in the third 
the sensing of reality appears normally active.’’! 

There have been many attempts to divide “mental 
types” into the synthetic and the analytic. Whatever 
one’s own reaction to the question of “‘types,” it is never- 
theless of interest to note some of the generalizations 
which have been made. Rignano? distinguishes between 
the synthetic and analytic ‘‘mentality” as follows: the 
possessor of the first is the discoverer of new concepts, 
he prefers comparison, analogies, the study of the 
broader relationships of cause and effect, and gives us an 
insight into the broad realm of any given field of en- 
deavor. The analyst, on the other hand, is reflective, 
patient, persevering, deductive in his method; an experi- 
menter, he prefers long, patient reasoning, and calculations 
complicated and almost unending. He appears to ad- 


1 Meumann, 17; 117. 2 Rignano, 22; 96. 
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vance prudently and surely, taking but a single step at a 
time. Among the synthesizers Rignano would place 
men such as Galileo, Newton, Faraday, Darwin, Comte, 
and among the analyzers, Watt, Stephenson, and Marconi. 

Maudsley distinguishes between assimilative and dis- 
criminative types. The first observes small, delicate 
resemblances which are imperceptible to others, the latter 
possesses predominantly the capacity for recognizing 
points of difference.1 

Again, Meumann, who has devoted so much of his dis- 
cussion of individual differences to “types,”’ distinguishes 
between the “‘analytic type”’ of person who is especially 
capable in the solution of single problems, in exact and 
analytic observation, a critic, a classifier — and the syn- 
thetic type, who is the builder of systems, one who 
manipulates and fashions whole regions of science. 
The analyzer is concerned more with differences, the 
synthesizer more with similarities, with the search for 
similarity and analogy. The first is “keen-sensed,’’ 
the latter is ‘‘deep-sensed”’ or especially capable of noting 
wider and wider relationships. The highest type is that 
in which both attain their highest development in a_ 
single individual. 

Meumann distinguishes still other types, which need 
not concern us for the present. 

Some data from animal and genetic psychology have 
an application to the questions under discussion. 

Biologists have almost entirely abandoned the search 


1 Maudsley, ‘The Physiology of Mind,” 283. 
2 Meumann, 17; 1509 ff. 
3 Meumann, 17; 161. 
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for that elusive if existent principle or trait which sepa- 
rates plants from animals. It would be rather generally 
conceded that all organisms manifest to some degree 
practically all the traits now claimed for higher animals.1 
The difference has been maintained to be one merely of 
degree or proportion. This view seems to be especially 
agreeable to those Weismannian disciples who believe 
that the primordial organism possessed, in the form of 
germinal determiners, all the potentialities for the devel- 
opment of all the higher species. 

From the simplest one-celled organism up to man, 
Jennings finds evidence of perception, discrimination, 
choice, attention, fatigue, desire, pleasure, pain, fear, 
memory, habit, and even intelligence.2 Of course, the 
lower down the scale the animal, the simpler are its 
mental mechanisms. But the germs of man’s psychic 
activity are assumed to exist as far down the phylogenetic 
line as the protozoa. There is a string of unbroken 
continuity between the behavior of lower and higher 
species. Hobhouse distinguishes four stages in mental 
evolution, each representing a separate degree of mental 
correlation and adaptation, which basically reduces to 
differences in the character and development of the 
processes of synthesis and analysis at each of the four 
levels. Ladd and Woodworth conclude that “greater 
power of analysis or discrimination belongs to man’’ 
as compared with animals. 


1 Tashiro, “A Chemical Sign of Life.” 
2 Jennings, 12. 

8 Hobhouse, ro. 

4 Ladd and Woodworth, 14; 555. 
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All experiments upon learning, animal and human, 
have clearly indicated the importance of attention, dis- 
crimination, and association in this process. This is illus- 
trated in the attempt of Ladd and Woodworth to term 
the “trial and error” learning in animals “learning by 
varied reaction through selection of the successful 
variants.” + Without variation in behavior-habit the 
right method would not have been hit upon by the animal 
in his learning efforts. And without attention, discrimi- 
nation, and association, even if chance success favored 
the animal, nothing would be gained which would be of 
future service in the same situation. 

James cites an instance where a dog, arriving with its 
master before a rowboat which they were in the habit 
of using, found it full of water. A sponge was generally 
used to bale this out. On this occasion the sponge had 
been left at home, about a third of a mile away. The 
master, disliking to make the trip, made gestures of clean- 
ing out the boat, at the same time saying to the dog, 
“Sponge, sponge; go get the sponge.” The dog ran off 
and brought back the desired article. To James this 
was evidence of nothing but contiguous association. If 
the dog had been unable to find the sponge and had 
brought back a dipper or a mop instead, “‘such a substi- 
tution would have shown that embedded in the very 
different appearances of these articles, he had been able 
to discriminate the identical partial attribute of capacity 
to take up water, and had reflected, ‘For the present 
purpose they are identical.’ ”? It is this power to analyze 


1Ladd and Woodworth, 14; 550. 
2 James, 11; 349-350. 
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out a detail common to a series of objects, acts, or phe- 
nomena, which possibly differentiates man from brute, 
and the superior among men in intelligence from those 
who are inferior. This process has its analogue in ab- 
straction. Miss Fisher found that the experience of 
similarity “(was the most important component detail 
in the process of generalizing abstraction”! and that the 
“experience of similarity and that of generality were 
in themselves strikingly akin.” ? 

In the case of animals it is a question to what extent 
varieties of past experience are interpreted in the light 
of a new situation. Thorndike doubts whether animals 
possess such generalized elements of thought as ideas. 
And although Hobhouse’s attitude is strongly affirmative, 
nevertheless 


“if we attribute ideas to an animal, they are not ideas 
arrived at by any breaking-up, analysis, or other elabora- 
tion of what is given in perception. None of my animals 
(with the possible exception now and again of the mon- 
keys) showed the least understanding of the how or why 
of their actions, as distinct from the crude fact that to 
do such and such a thing produced the result they 
required. It is this want of what one may call analysis, 
that made, for example, the push-back bolt such a diffi- 
culty. What Jack or the elephant knew was, crudely, 
that they had to push this bolt. That the reason why 
they had to push it was to get it clear of the staple they 
obviously never grasped.” § 


How remarkably analogous is the mental functioning 
of the animal as here pictured with that of the high-grade 
moron, who knows what is right and what wrong, but 


1 Fisher, 7; 97. 2 Fisher, 7; 208. * Hobhouse, 10; 200-201 
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fails to grasp the “why.” Is it a question of synthetic- 
analytic incapacity? We shall have occasion to return 
to this matter again later. 


“Tf then, positively, these experiments suggest ‘prac- 
tical ideas,’ negatively, they strongly suggest absence of 
any sort of analysis in the genesis of those ideas. An 
animal can shift its attention to this or that object, or 
change within the sphere of perception; but it cannot 
apparently follow out the structure of any complex object 
with any minuteness and accuracy.” ! 


Some contributions from the field of genetic psychol- 
ogy are illuminating. We are frequently told that the 
child deals with the concrete; the adult with the ab- 
stract. This means, presumably, that the child deals 
with the isolated, with objects as they have been imme- 
diately perceived — the adult, however, has generalized 
and has abstracted common properties and deals with 
these idealizations by means of word symbols or physio- 
logical set. To experience the meaning of “twenty,” or 
of ‘promise,’ or of “opposite,” or of “justice,” is 
apparently beyond the power of children’s mental 
capacity. Progress in this respect comes with chrono, 
logical age and with the character of native mental en- 
dowment. It is quite apparent that ‘In mental growth 
connection and analysis, association and dissociation, 
putting things together and breaking things up into 
parts, constantly work together.” ? 

There are a few pedagogical implications worth men- 
tioning with regard to this synthetic-analytic activity. 
Education, according to Royce, involves, first, “acts of 


1 Hobhouse, 10; 201 2 Thorndike, 28; 219-220 
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sensory observation, of recalling images, of repeating 
words, of drawing diagrams, of performing experiments, 
and so on, indefinitely. Then we acquire gradually the 
_ power to ‘survey at a glance,’” and “this process of 
surveying at a glance involves a high degree of differen- 
tiation of our simultaneous conscious states.” ! This 
ability to bring to consciousness a mass of related facts, 
data, information, experiences, to pick out the essentials 
necessary for the purposes of the particular moment, or 
to select and epitomize, or summarize relevant details 
for interpretation as a unit — that is truly mental func- 
tioning close to its apex of development. Meumann 
emphasizes the importance of combinative ability when 
he speaks of difficulties in work of the schoolroom, in 
geography, for example: 


“Defective capacity to learn geography may be due 
either to sub-normal ability to deal with concrete visual 
imagery (maps and the like); or when normal visual 
imagery and normal memory of names is present, it 
may be due to an inability to combine concrete visual 
images with the auditory-motor images of words.” 2 


In the aphasias we possess excellent illustrations of total 
absence of specific combinative potentialities, which of 
course have clearly demarked neurological bases. Royce 
has conceived the educative process as “an attainment 
of synthesis by means of analysis.”* And analysis “‘is 
manifestly one of the most incessantly performed of all 
our mental processes.”’ 4 

By emphasizing the importance of analysis and synthe- 


1 Royce, 24; 254. ® Royce, 24; 258 
2 Meumann, 16; 204. James, 11; 502. 
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sis for normal mental functioning we are not claiming a 
berth for a new “faculty.” Evidence of every kind is 
again and again demonstrating the unity of mind, and 
the integrative character of its physical substrate: the 
nervous system. We cannot localize “analysis” and 
“synthesis.” These tendencies seem to be properties 
inherent in nervous protoplasm, present the very 
moment an aggregate of nerve cells become organized 
into any form of functional unit. This fact emphasizes 
again Wundt’s declaration that 


“there is, in reality, but one psychical center; and that 
is the brain as a whole, with all its organs. For in any 
at all complicated psychical process, these organs are 
brought into action, if not all together, at any rate over 
so wide a range and in such various quarters as to forbid 
the delimitation of special psychical centers within the 
functional whole.” ! 


And one wonders if James was not correct when, in dis- 
cussing “analysis” he apologized for the short space 
devoted to this activity and insisted: “TI think I empha- 
size it enough when I call it one of the ultimate founda- 
tion-pillars of the intellectual life.” ? 


3. NEUROLOGICAL ORIENTATION 


Our discussion of mental mechanisms invariably 
forces us to a consideration of the anatomical and the 
physiological structures underlying them. Comparative 
psychology has often emphasized the slight differences 
in the sensory capacities between man and animal. 
And wherever the difference has been emphasized it has 


1Wundt, 34; 218. ? James, II; 530. 
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often been stressed in favor of animals. Our studies of 
the feeble-minded reveal slight, if any differences, in the 
sensory capacities of normal and mentally deficient. It 
seems that the factors which make for intelligent be- 
havior do not reside in a refined sense-organ, necessarily, 
although refined sense-organs are extremely desirable. 
Intelligence is something cerebral. We, therefore, 
naturally look for the clearest exemplification of the 
activity of the analytic-synthetic tendency in the func- 
tion of the cerebrum. 

Most anatomists and neurologists agree that no true 
nervous elements are evident in our progress from lower 
to higher organisms until we reach the coelenterates. 
The Protozoa possess no nervous system. The Metazoa 
do. Jennings finds no evidence to explain the behavior 
of the Metazoa as different on the basis of their posses- 
sion of a nervous system. What the Metazoa do, the 
Protozoa can also do. ‘The possession of a nervous 
system brings with it no observable essential changes in 
the nature of behavior. We have found no important 
additional features in the behavior when the nervous 
system is added.”! In Vorticella, Jennings found that 
the receptive end is ciliated peristome. Stimuli of cer- 
tain kinds will be transmitted and contractions of the 
myoid filament at the fixed end of the cell will be notice- 
able. In multicellular organisms the same simplicity of 
nervous mechanism is observed, with this exception: 
increased complexity of the nervous fabric is correlated 
with greater delicacy of individual readjustment to 
changes in environmental conditions. What is of espe- 


1 Jennings, 12; 263. 
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cial significance is the fact that “the peculiar properties 
of the nerve cells are properties of protoplasm in general, 
but somewhat accentuated.”! Each cell of our body, 
although there are comparatively few like itself, never- 
theless is capable of uniting in function with others 
strikingly different in structure. The nature of those 
conditions making for unity of function out of a diversity 
of structure, certainly implies a synthesis of a most 
subtle nature, true for somatic protoplasm as well as for 
nervous. 

The work of Sherrington, epoch-making in its contri- 
butions toward our understanding of nervous mech- 
anisms, throws some light on our question. 


“The nervous system in its simplest forms is diffuse — 
a number of scattered mechanisms performing merely 
local operations with much autonomy save that they 
have communication with their immediate neighbors 


across near boundaries.? . . . It is ill suited, therefore, 
to produce the integration of a large and complex indi- 
vidual as a whole . . . Yet the codrdination it brings 


about in its own local field may be strikingly effective.’”’4 
The earthworm is a good example of a segmented or 
metameric nervous system. Each metamere leads an 
almost independent existence. But “the integrative 
function of the nervous system is seen to perfection in the 
welding together of metameres into the unity of an 
animal individual.”* There are hierarchies of nervous 
integration paralleled by hierarchies of functional 
organization. 

“By longitudinal integration short series of adjoining 


1 Jennings, 12; 280. 4 Sherrington, 25; 312. 
2 Sherrington, 25; 311. 5 Sherrington, 25; 314. 
8 Sherrington, 25; 311. 
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segments become in respect to some one character com- 
bined together, so as to form in respect to that character 
practically a single organ.!. . . And it is in the inte- 
gration of long series, or of the whole series, of segments 
one with another, that, apart from psychical phenomena, 
the nervous system seems to reach its acme of achieve- 
ment: * 


Jennings has presented a great mass of evidence dem- 
onstrating the constant ‘feeling about” of all lower or- 
ganisms, the attempting of new directions, the retiring 
from those which are harmful, and the persisting in those ~ 
which are of advantage to the organism. This feeling 
about, this avoiding and persisting, force one to grant 
some degree of discrimination to the animal, and once 
that is granted, the existence of a fundamental analytic- 
synthetic element logically follows. 

Present-day evidence has demonstrated that the neu- 
ron is an anatomic, genetic, physiologic, trophic, and 
functional unit. Each neuron is a complete cell in and 
of itself. Nevertheless, the complexity of interconnec- 
tion between neurons is beyond human comprehension. 
From the simplest reflex to the most complex higher 
thought process a basic tendency of ‘‘ get-together-ness”’ 
and “‘stay-together-ness”’ is observable among neurons. 
And where it is absent or defective, mental progress 
from infancy to adulthood can hardly be conceived. 

The passage of stimuli through sensory pathways and 
the complexity of interconnection between what Sher- 

1 Sherrington, 25; 344. 

2 Sherrington, 25; 344. 


* See Jennings’ description of the behavior of an amoeba in pursuing 
another for the purpose of devouring it. — Jennings, 12; 16, 17. 
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rington designates the “silent areas,’’ illustrate the com- 
plexity underlying mental mechanism. The terminal 
nuclei and the thalamus are among the important way- 
stations to cerebral connection. But 


“the thalamus, since it possesses many short fibres con- 
necting its own parts, is probably something more than 
a mere way-station. Apparently, the sensory impulses 
from the different receptors come together here and 
join in such a way that the impulses which pass from 
here to the cortex are already organized to a certain 
extent.”! 


What function other “relay” stations or connecting 
links play in synthesizing and organizing primary mental 
states can only be conjectured. Throughout his book 
Sherrington stresses the interconnecting or “integrative” 
function of the nervous system, which makes for a unity 
of action out of a diversity of organs. 

In running through the evidence presented on the 
mental changes which result from cortical ablations, 
one is amazed by the contradictory results which have 
been found in various quarters. Careful experimentation 
in the last few years, notably that of Franz in this coun- 
try, is demonstrating with greater and greater conclusive- 
ness that the integrity of the cortex is necessary for the 
integrity of mental functioning. Meynert makes a good 
deal of the fact that disorganization of any portion of 
the cortex manifests itself in some form of psychic dis- 
turbance.2 Morat stresses the fact that the brain may 


1 Ladd and Woodworth, 14; 93. 
2 Sherrington, 25. 
3 “Populdre Vortrige,” 2 ff. 
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be regarded “‘a prodigy of unity” as well as “a prodigy 
of complexity.”! Mach concludes that “A review of 
anatomic, physiologic, and psychopathologic findings 
forces one to the conclusion, that the integrity of con- 
sciousness is dependent upon the integrity of the cor- 
tex.”2 And finally, the careful work of Franz leads 
him to the generalization that, “Both the clinical and 
the physiological evidence points to a dependence of 
certain mental processes on the integrity of the frontal 
lobes and, in fact, on the integrity of the brain as a 
whole.” 


4. SUMMARY 


To summarize: Whether we investigate the purely 
mental aspects of our behavior, or whether we observe 
the integrating of nerve element with nerve element, we 
are struck with the significance of synthesis for normal 
mental functioning. We shall have occasion in a later 
chapter to consider the current definitions of intelligence, 
and with this new orientation we shall suggest another 
definition which perhaps will take us back to something 
more fundamental than “adaptation.” 


1 Morat, 18; 1. 2 Mach, 15; 42. 8 Franz, 8; 64. 
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PART B 
THE BLOCK-DESIGN TEST 


THE BLOCK-DESIGN TEST! 


CHAPTER I 


Statistics Regarding the Subjects who Were Given the 
Block-design Tests 


In the following division we shall present tables giving 
the chronological ages of the subjects, arranged by 
source; the Binet mental ages of the subjects, arranged 
by source, the Binet mental ages and the intelligence 
quotients arranged by sex and source; the correspond- 
ence of chronological and mental ages, totaled separately 
for sex and source; the age-grade distribution, classified 
by sex; an age-progress table, classified by sex; nation- 
ality; place of birth; social class; home conditions; 
and teachers’ estimates of intelligence. The question- 
naire on p. 61 was utilized to obtain most of this infor- 
mation. The aim was to make certain that the group 
selected was typical, and if atypical, in what direction 
and to what extent. The results seem to show that the 
children selected were representative of the larger dis- 
tribution of children at large and consequently the final 
norms seem valid. Mayfield yielded children somewhat 
inferior, Palo Alto yielded children somewhat superior, 
and Menlo Park more of an average type. 

Table I shows the life ages of the children tested. At 
almost every year the cases number between 20 and 30, 
and the years range from 4 to 16 in the case of the pub- 
lic school children, and from 9 to about 37 in the case 

1The complete set of material may be obtained from C. H. 


Stoelting Co., 3037-3047 Carroll Ave., Chicago, Illinois. 
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of the feeble-minded. The Mayfield cases numbered 93, 
the Palo Alto 110, the Menlo Park 89. There are 28 
feeble-minded cases included from the Vineland, N. J., 
Training School, and 47 feeble-minded cases from the 
California State Home for the Feeble-minded, making a 
grand total of 367 cases. Each of these was given the 
block designs, the two Trabue tests (B and C), the 
Binet test, and the dissected sentences test. “The time 
spent in the examination of each case varied from one 
hour to three hours, the average being about two hours. 
Almost all of the examinations required two sittings, in 
some cases three. At no single time was a subject kept 
over an hour and a half. Conditions for examination 
were always excellent. The writer, who did all the ex- 
amining, always had a room apart, free from disturb- 
ances and distractions. 

In Table II are given the mental ages of the subjects 
examined. It will be observed that most of the ages are 
clustered between 6 and 13. All considered, this is an 
excellent range, the number of cases at each age varying 
from 20 to 50. 

In Table ITI are given the Mental Ages and I. Q.’s for 
the public school boys and girls. The modal I. Q. for 
both groups, separately and combined, is 100. Table IV 
gives the I. Q.’s for the feeble-minded. The median 
I. Q. for the feeble-minded falls in the 50 I. Q. group. 

It is evident from these tables that there is a positive 
correlation between increase of mental age and increase 
of intelligence quotient. Supposedly we would expect 
no correlation. But our school group is evidently se- 
lected. In the grammar grades there has been some 
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elimination of the mentally retarded, and this is especially 
striking in the high school grades. Our schools seem to 
demand higher mental ages and higher I. Q.’s for prog- 
ress through the grades. In the primary grades I. Q.’s 
fall as low as 56. In the intermediate school there was 
only one case below 76, and in the high school there was 


TABLE IV 
F. M. Group 


INTELLIGENCE QUOTIENTS 


Vineland’ = 2* 3. Tel MOT ese ever aes en ee I 


Kldnidgesem, ba: Onl ieout o wal AG 2 2 I 
Totals Soe aes Tole hres oro: ero atom lars 2 Lys 


MepiAn I. Q. = 50 


not a single case with an I. Q. less than 86. Another 
item of importance: the upper right-hand section of 
Table III includes children who are accelerated men- 
tally but retarded pedagogically, and the lower left-hand 
section of the table includes children who are retarded 
mentally, but accelerated pedagogically. 

In the public school group, 189 out of the 292 have 
I. Q.’s between 86 and 115 —in other words, 64.7 per 
cent have average intelligence. 

Table IV gives the distribution of I. Q.’s for the 
feeble-minded cases. And Table V summarizes the 
totals in Tables III and IV. 

Tables VI to XII present in detail the I. Q. dis- 
tributions for each source, with its median I. Q. The 
median I. Q.’s (crude) for the various schools were, 
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Mayfield, 90; Palo Alto High, 110; Palo Alto Inter- 
mediate, 100; Palo Alto Lytton, 100; Menlo Park, go; 
Vineland, 45; Eldridge, 50. 
TABLE VI 
MAyFIELD CASES 


INTELLIGENCE QUOTIENTS 


AGE 40 50 60 7O 80 90 I00 
4 I 
5 I I 
6 r Ek 
7 I 20-2 7A ake 
8 I 2 Bhs. CE 
9 PaSEVo2: cE 2 
10 I 2; I 3] 2 I 
Il I ES 2) I 
I2 3.) 2.2 I 
13 EF 2} 32 
14 I 
15 
16 
I 2 1/4 O6\r1 r5\|10 7] 6 16 
Nee | ae a ae) 
Total | x |! 3 | To} 26 | 17 | 22 
MenprAn I. Q. = go 
TABLE VII 
Pato Atto INTERMEDIATE 
INTELLIGENCE QUOTIENTS 
Menta AGE ToraL 
70 80 go 100 IIo 120 
Il bf x I 2 I 3 3 
12 I 2 I 2 3 3 
13 I I 2 
14 I I vA kamera Sal Ur. Ge 
15 
16 I I 
r 2 DOSS ass B42 202 Lira) 4p 
vy | eS | Sr |] | ee | | * 
Total . I 3 5 5 4 3 21 
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TABLE VIII 


Pato Arto HicH 


INTELLIGENCE QUOTIENTS 
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TABLE Ix 


Pato Atto LyTTon 


INTELLIGENCE QUOTIENTS 


MENTAL AGE TorTaL 
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TABLE X 
MENLO PARK 


INTELLIGENCE QUOTIENTS 


MENTAL AGE 
60 70 80 90 100 IIo 
6 ER 2 ar ee 
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TABLE XI 
ELDRIDGE 


INTELLIGENCE QUOTIENTS 


MENTAL AGE 
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TABLE XII 


VINELAND 


INTELLIGENCE QUOTIENTS 


20 30 40 5° 60 70 80 TOTAL 
3 I 2 tend 
4 22 I 3.2 
5 rer Peer 
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In Table XIII are presented the mental age and 
chronological age distributions for the public school 
group. It is evident from this table that there is a some- 
what larger percentage of those who are retarded men- 
tally than accelerated: 36 (12 per cent) are accelerated 
more than one year, and 81 (28 per cent) are retarded 
more than one year. In Table XIV the data of Table 
XIII are summarized for years of retardation and ac- 
celeration. It will be observed that 59 per cent are at 
age mentally, or within one year; 22 per cent are 
within two years; 9 per cent are within three years; 
7 per cent are within four years; 2 per cent within 
five; and 1% of 1 per cent within six years of their 
mental age. 
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TABLE XIV 
MENTAL AGE Boys GIRLS TOTAL 
5 yrs. 4 4 
4. 3 3 6 
Above CvaKe 2 I © 30 
Baws Io 13 23 
ce 26 20 46 
At Age 41 43 84 173 
I yr 25 18 43 
2 yrs 21 19 40 23 
Below ae y 13 25 
. 4 9 6 15 83 
5 “cc I I 2 
Cee I I 
Potakee Ae 154 138 292 


In Graph 1 is presented graphically the retardation 
and acceleration of the 292 public school cases. A skew 
is observable toward the right. This is again manifest 
in Graph 2, which graphically represents the distribution 
of I. Q.’s for the same group of children. In making a 
comparison between the grouped distributions of I. Q. 
obtained by Terman in his revision of the Binet for 
gos cases and our results, we note the following: Ter- 
man found 35 per cent having I. Q.’s above average, in 
our cases 25.4 per cent were above average; he also 
found 33.9 per cent average (96 — 105 I. Q.), in our 
cases 28 per cent were average; and he found 31.3 per 
cent below average, while in our cases 46.6 per cent were 
below average. Our inferior group is 15 per cent larger, 
the average group is about 6 per cent smaller, and the 
superior group is about 10 per cent smaller. The fact 
that Terman excluded the foreign-born, which have 
been included in our data and amount to about 5 per 
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Number of Children 
at, Above and Below Age 


Public School 


Public School 


Class 100 Includes 
I. Q.8 from 96-105 
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cent of the public school cases, would help account for 
the discrepancy. We have also made no eliminations 
because of race or nationality. As Pintner has so ably 
stated, the mere fact of large numbers of cases is no safe- 
guard for reliability of standardization; and in obtain- 
ing accurate norms, individuals of all classes and degrees 
should be included.+ We have stressed careful technique 
rather than multiplicity of cases, or perfection in sam- 
pling. 

Table XV is the age-grade distribution of our public 
schoo! cases. What is striking here is the practically 
symmetrical distribution as compared with the skewed 
curve for the mental ages and I. Q.’s._ This is clearly 
brought out in Table XVI, which summarizes briefly 
the data of Table XV. It will be observed that 35 per 
cent are at age pedagogically, 31 per cent are acceler- 
ated, and 34 per cent are retarded. The percentage at 
or within one year of grade is 83 per cent. 


TABLE XVI 
Boys Grrts ToraL 

SiYIS, ve Se I I 

Above grade} 2yrs.. . 8 6 14 

1 31 45 6 

Atageforgrade . . . 53 49 Bk 

CVE Sc 38 26 64 

CN RE 5 17 r0) 26 

Below grade} 3 yrs... 6 2 8 
ASVTScs oe 

BS ViSian nk I I 

Potali) eo ese 138 292 


’ See R. Pintner and D. G. Paterson, “A Scale of Performance Tests,” 
pp. 73 fi. 
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Tables XVII and XVIII are concerned with the cor- 
relations between grade and progress, or the number 
of years spent in school: 40 per cent had made normal 
progress, 41.5 per cent had made accelerated, and 18.5 
per cent had made retarded progress. The percentage 


TABLE XVIII 

Boys Giris TOTAL PER CENT 
AYISO Ya toby 2 2 7 
Accelerated } 3 yrs. . . I 2 3 te f 
Progress YTS 4 bce) 14 4.7 
FAV Poe aa ale 54 48 102 34.9 
Normal progress . . . 60 57 TL7 40.0 
Retarded Ee yts hee 29 15 44 15.1 
Progress BR geo : 5 7 == 
BSVESS oes 2 I 3 Zr 
otal wwe a 154 138 2092 100.0 


making normal progress, or within one year of it, 
amounted to go per cent. The numbers making rapid 
progress are unusually large. This is accounted for by 
the fact that a good part of the testing came in February 
and March (1918) when children had just been promoted 
to a new grade. They were thus given credit for progress 
in that grade in which they had not yet made any 
progress at all. Taking this into account, the grade- 
progress distribution is of about the same type as the 
age-grade. 

In Table XIX are given the numbers and per cents 
of boys and girls who are at grade or within one year 
of it by chronological age (termed ‘‘in the right grade”’), 
and who are between 86 to 115 I. Q. (termed “right 
I.Q.”). It is clear from the table that 60 per cent of the 
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TABLE XIX 
GRADE LOCATION AND TI. Q. 


NUMBER Per CENTS 


Torat |PERCENT 


In right grade and 
of right IQ... 


Neither right grade 
nor right I.Q. . 


Right I. Q. only 
Right grade only . 


total. 


By “Right Grade” is meant at grade or within one year of it for 
chronological age. 
By “Right I. Q.” is meant an I. Q. between 86 to 115. 


children are what may be termed “average” and these 
help stabilize any tendency toward deviation from the 
absolute norm. 

In Table XX is given a list of geographical divisions 
and the number claiming descent from the nations of 
that region. Ranked for frequency, the leading nationali- 
ties came in the following order: North European, 
American, and combinations of North European and 
American. These accounted for over 80 per cent of all 
the cases. The descendants from northern groups num- 
bered 80.4 per cent, from southern groups 11.7 per cent, 
Orientals 3.4 per cent and from those not stating 4.5 
per cent. 

The data on birthplace by states, summarized for 
geographical division, and for birthplace in California 
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or outside of the state, are here presented: 74 per cent 
were born in California, 26 per cent were born elsewhere. 
The Pacific Coast States contributed 76.5 per cent, 
Mountain States 5.2 per cent, East North Central 4.5 


TABLE XX 
NATIONALITY AND BIRTHPLACE 


NUMBER Per CENT 

(z)) North European’ 0 9. 108 37.0 
(@)SouthjBuropeaniess 7) Saal te 22 7.6 
(iA TCT CAT SF lee ce vas slatepemtot i enna gi 31.1 
(4) Oriental . . Sans ves 10 3.4 
(5) American and N. European eee 36 12.3 
(6) American and S. European. . . . 5 r.7 
(7) N. European and S. ee Soe 7 2.4 
(8) Pornotstated . . es 13 45 

Totals Avy ecttt Seu a Oe, eet ere he 292 100.0 


per cent. The smallest numbers came from the East 
South Central States (.7 per cent) and from the New 
England States (o per cent). 

Tables XXI to XXIII and Graphs 3 to 5 give the 
results of teachers’ estimates of intelligence, home con- 
ditions, and social class. The writer has devised a 
series of tables for grouped measures of variability which 
are given in the appendix and which are here utilized 
for the purpose of comparing the percentages actually 
found with what one would expect theoretically. It 
will be noted that the average discrepancy for intelli- 
gence estimation is only 2 per cent, for estimation of 
home conditions 3 per cent, and for social status 4 per 
cent. This increase is to be expected, for to teachers, 
intellectual performance is under their observation 
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continually, and this is not as true for home conditions 
or social status. 
TABLE XXI 
TEACHERS’ ESTIMATES 


INTELLIGENCE 


THEORETICAL 
EXPECTATION 


NUMBER Per CENT DISCREPANCY 


Very inferior. . . . 4 1.4 +1.2 
Enfentorae Goa. ~~. Ir 3.7 —0.3 
Below average . . 52 17.8 —6.2 
Average . eetse 133 45.5 +1.9 
Above average. pee 68 23.2 —0.8 
DUPEHOEY Fa leh es! 21 7.3 +3.3 
Very superior . . . 3 F.1 +o0.9 
sBotaless | cre 292 100.0 
AVERAGE (A. M.) DiscrEPANCY = 2.1% 
* See Appendix I, 
TABLE XXII 
TEACHERS’ ESTIMATES 
Home CONDITIONS 
Noumper | Per Cent pd biases DIscREPANCY 
Very inferior. . . . 2 0.7 02> +0.5 
Inferior nD ep eee 1 6.0 4.0 +2.0 
Below average . . 57 20.2 24.0 —3.8 
Average. seg 113 40.0 43-6 —3.6 
Above average. gene 56 19.6 24.0 —4.4 
Sifperiofis 5 8. 26 9.2 4.0 +5.2 
Very superior. . .. 12 4.3 0.2 +4.1 
CMe ake! ms 9 
Potale nyse estes 283 100.00 100.0 


AVERAGE DISCREPANCY = 3.4% 
* See Appendix I. 
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TABLE XXIII 
TEACHERS’ ESTIMATES 


SocraL STATUS 


NumpBer | Per CENT bees seat DIscREPANCY 
Very inferior. . . . 5 1.7 0.2* +1.5 
Inferior” 0s.” Sites, ¥ 16 5.7 4.0 +1.7 
Below average . . 47 16.8 24.0 —7.2 
IAVETARC Dee wala 2 132 47.3 43.6 +3.7 
Above average . . 48 17.4 24.0 —6.6 
SUperlOr a) cw tee ss 2I 7.5 4.0 +3.5 
Very superior . . . Io 3.6 0.2 +3.4 
a ecru 13 
CotalGta-. aeons 279 100.0 100.0 


AVERAGE DISCREPANCY = 3.9% 


* See Appendix I. 


TEACHER'S ESTIMATES 
Intelligence 


Aver. 
Super. 
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Home Conditions 


Py 
=| 
v 

o 
bj 

a 


Pn | ol 
ae | wy 
a leet 
| 5! 

I> al 


Infer, 


f=) 
n 

Summing it all up, we have tested a fairly representa- 
tive group of school children, on the whole perhaps not 
markedly different from average children in other parts 
of this country. 


SAMPLE OF QUESTIONNAIRE 


To the Teacher 


The information rendered on this blank will be held 
strictly confidential, will be used for statistical purposes 
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only and without the mention of any child’s name. 
The information will aid greatly in the standardization 


of 


Au kop o 


7: 


a series of block-design tests. 


Name:of school .\).ci. .< icc cee eels ee ee eee ee 
Name. of pupil..'.2..c<2 $00) os ea eee eee 
Date of birth::..3.20i.5.a cia cane we ee ee 
Grade (when test was madé)..<./i.<0:. «2-5 seen 
. Years attended school. ..Grades skipped. . . Repeated. . . 
Place of birth.: .:. 322 s6.c5 a. 2) ce ee eee 
(what state if American, what country if foreign). 

Descendant of what nationality...................... 
(E.g., Scotch-Irish, Portuguese, German-American, etc.) 


8. Language spoken at home. ........ .. sos seen eee 
9.7 Occupation ‘of father: << .c2,)..2> anon eee 2 ate moet 
10. Quality of the child’s work (as compared with average 
children for this grade). (Write appropriate number, 
see tating scale)... 50 stan cys hv ee oe 
11. Teacher’s estimate of the 
child’s intelligence (as 
compared with aver- 
age children of the Rating Scale 
same age). In your ratings indicate 
(Write appropriate 1. Very Inferior....... by 4 
number, see rating 9, Inferior............ by 5 
SAIS VOR Rconict Ais hecas, EN 3. Below Average......by 6 
12, Home conditions (con- 4. Average............ by 7 
sider neatness, size, 5. Above Average..... by 8 
comfort, provision of 6, Superior........... by 9 
life necessaries, rela- 7, Very Superior...... by 10 


tions between the par- 
ents, parental super- 
vision). 

(Write number)........ 
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13. Social class (consider culture, intelligence, social posi- 


(Write number) 


tion of the group from which the child comes). 


Se WR, SR Oke AeA ee 6 Gi aa &) Bos. Stel eile) poe, a) eal ee bee. -s 


14. What is the character of the child’s work in the following 


PORPery 


(Write number) 


school subjects (use rating scale). 


ee  Y 


PORGIN 0s trea ws 8. Drawing 422 - sft 
WN TREMNES 0i. 5 eae se tu g. Nature Study ........ 
SIERO S/n nhc sie os. 10, MUSIC ES hs a etnies 
EAD OUI OC one ais isin trad « 11. Manual Training...... 
PAVED MOHIC..5 55 oa wla,km's 12. Household Arts....... 
I PISEOEY cre 4's ainisis P2. i OCIOECO sit pre ecem ats 
GREOPTEDEY 5.65 cs kas 14.. Deportment... fa50- 0). 


15. If this child were given a mental test involving chiefly the 


use of language, or the ability to understand and 
handle language symbols (as contrasted with a test 
requiring silent observation and performance), would 
you expect: him, (her) to pass... «s.1.<scce6 cede 
Very low 

Low 

Below Average Note. — Put an X before 
Average the appropriate word 

Above Average 

High 

Very High 


16. Additional information which will throw light on the 


child’s intelligence, school success or failure, social 
status, peculiarities of any sort, etc. will be especially 
welcome and appreciated. We thank you. 


CHAPTER II 
The Test Material 


I. THE MATERIAL 
(a) The Blocks 


The blocks which are used are manufactured by The 
Embossing Co., are called “Color Cubes,’ and may 
be secured at any of the large department stores and at 
the various distributing centers of Milton Bradley’s. 
There are sixteen cubes of one inch dimension and all 
are painted as follows: 


One side red, 

One side blue, 

One side white, 

One side yellow, 

One side blue and yellow (divided on the diagonal), 
One side red and white (divided diagonally). 


The character of the colors is indicated on the pages of 
designs printed in this monograph. A slight difficulty, 
experienced by possibly one or two subjects out of every 
one hundred, was a just perceptible but nevertheless dis- 
concerting difference in shade between the blue and yel- 
low on the full faces and the same colors on the diagonal 
sides. This can be remedied in the later standardization 
of the test material. One set of six blocks will last 


through the examination of from four to five hundred 
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children without showing much wear and tear. After 
that the cubes can be repainted without difficulty. 

It is interesting to watch the response of children and 
even adults when they are given colored cubes to handle. 
There is no doubt that an appeal exists which touches the 
roots of some very fundamental original tendencies. Of 
all the subjects tested, not one has manifested any 
absence of a desire to combine these cubes in some 
fashion. The experimenter needs only to direct this 
natural interest toward a specific end and then apply a 
scientific measuring technique to evaluate the results. 


(b) The Designs 

On pages 66-67 are presented the designs utilized 
in this study. The Roman numerals refer to the num- 
bers given the designs during the time when the tests 
were being standardized. The Arabic numerals designate 
the final numbering of each design. The original number 
was thirty-five, but fifteen were eliminated in a few of 
the early preliminary testings. The designs are graded 
in difficulty which increases by modifying the designs 
at various stages in the following manner: 


. By the use of the full colors; 

By the use of few diagonaled sides; 

By the use of all diagonaled sides; 

By turning the design on one of its corners; 

By eliminating the outside boundary line; 

By increasing the number of blocks to be used; 

By increasing dissymmetry in design; 

By decreasing the number of different colors used 
in each design. 
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Trial Design A 
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To perform the test, utilizing the twenty designs, one 
averaged about an hour or an hour and a half. In the 
final revision three designs have been eliminated, leaving 
seventeen, thus decreasing somewhat the time necessary 
to apply the tests with no significant decrease of relia- 
bility. The criteria for rejection were based on correla- 
tions with those arrays of evidence presuming to yield 
an index of intelligence, such as is obtained through 
the use of the Binet scale, and also upon the basis of the 
diagnostic value of each design, determined by the pro- 
gress of its curve with increasing chronological age. The 
results at present indicate that the block designs are as 
good as any single test in the Binet scale (though better, 
perhaps, in the sense of diagnostic value), as good as the 
Trabue Language Completion Tests, or any other similar 
single type test, whether involving the use of language 
or whether mere performance. 

The designs, appropriately colored, are printed on 
medium-thick, white, semi-gloss cardboard. The di- 
mensions of the card are three by four inches. The 
printed designs, placed in the center of the card, are one- 
fourth the size of the actual designs when the cubes are 
used. In other words, the face of a cube represented on 
the designs is only one-half of an inch on each of its sides. 
Thus design No. 1 is one inch square, design No. to is 
one and a half inches square, and design No. 14 is two 
inches square. 

The writer has found it of assistance to place in the 
lower right-hand corner the time limit for each design. 
These values follow: 
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TABLE XXIV 


Time Liwits ror Eacu DEsIGN 


DESIGN Tme Louor DESIGN Tome Lunor DESIGN Tre Lair 


(NUMBER) (MrnutEs) (NUMBER) (MINUTES) (NUMBER) (MinvteEs) 
I 1% 7 2 1 fim ne y 

2 1% 8 2 BH Lore 38 

3 1% 9 2 ea ae 4 

4 2 Io 3 TOs. oe 4 

5 2 II 3% gy ae be 4 

6 2 12 3% 


The time limit set for each design is about one minute 
longer than the time within which a correct response 
may reasonably be expected. 

It may be of interest to remark that if the full limit 
is allowed on each test the working-time totals only 
forty-five minutes for all of the seventeen designs. With 
practice an examination should average about thirty 
to forty minutes. In some cases it may take only fifteen 
or twenty minutes, in others perhaps an hour. 


(c) The Score Card and the Method of Scoring 


In the succeeding table are presented the score values 
of each of the seventeen designs and the number of score 
points to be deducted if a design is successfully com- 
pleted with excess time and with excess moves. 

To clarify the table, one or two illustrations will be 
utilized. For example, design No. 2 has a score value 
of 5. This full amount is attained if a reagent completes 
the design successfully in less than 31 seconds and with 
less than 7 moves. If 31 or more seconds are utilized, 
one point is deducted from the score, and if 7 or more 
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moves are made an additional point is deducted. Take 
again design No. 13, which has a score value of 9. This 
full amount is attained if the subject completes the de- 
sign successfully in less than 2 minutes and 21 seconds, 
and with less than 31 moves. If completed between 


TABLE XXV 


ScorRE CARD 


PoINTS TO BE SUBTRACTED 


ScorE 


DESIGN 
vee Excess TIME eecesd Moves 
1 Pont 2 Points ope 

I 3 21” and over 6 and over 
2 is 31” and over 7 and over 
3 6 20. tonsa 36” and over 8 and over 
4 7 Brit (ii Oy 1’ 1” and over Io and over 
5 7 30! toms 1’ 6” and over rr and over 
6 7 36” to 1’ 0” 1’ 1” and over 12 and over 
7 a] Aneto LTO" r/11” and over rr and over 
8 8 Abe tomes Se 56” and over ro and over 
9 9 56” to 1/10” 1/11” and over 15 and over 
Io 9 1’56” to 2'10” 2/11” and over 22 and over 
II 8 1/46” to 2'30” 2’31” and over 1g and over 
12 9 2'26” to 2’40” 2’41” and over 30 and over 
13 9 2'at” to 2/33” 234” and over 31 and over 
14 9 2'26” to 2'40” 2’41” and over 32 and over 
15 9 a'ar* fo13!0r 3’ x” and over 32 and over 
16 ro alan to 3 nse 3’ 6” and over 31 and over 
17 II 2/41” to 2/55" 2'56” and over 30 and over 


Maximum score — 133 points. 


2 minutes 21 seconds and 2 minutes 33 seconds, one 
point is deducted; and if 2 minutes 34 seconds or more 
are spent on the problem, two points are deducted. 
And if 31 or more moves are made an additional point is 
deducted from the score value of the design. 

The scoring of a performance is a very simple matter. 
This will be self-evident from the following examples: 
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Example one: Design No. 7 successfully completed 
in 1 minute and 23 seconds and at the end of 9 moves. 
Score 7, for successful completion, less 2 points for 
excess time. Final score 5. 

Example two: Design No. to successfully completed 
in 1 minute 48 seconds, and after 19 moves. Score 9, 
for successful completion. No deductions for excess time 
or excess moves. Final score, 9. 5 

Example three: Design No. 16, successfully completed 
in 3 minutes 27 seconds, and after 48 moves. Score 10, 
for successful completion. Deduct 2 points for excess 
time, and one point for excess moves. Final score 7. 

It may be worth remarking that successful perform- 
ance, speed, and what may be termed accuracy are 
combined in the final score. Successful performance 
receives greatest weight, speed next, and accuracy next. 
The weight ratio as explained elsewhere in the mono- 
graph is roughly 4:2:1. This ratio has been empi- 
rically determined. The prevalent opinion that speed 
and accuracy cannot be combined in one score, does 
not hold with the Block-design Tests. The writer felt 
that success, speed, and accuracy each had its own 
diagnostic importance, and in order to make the tests 
most effective all should, and must, be taken into ac- 
count in the final score summation. For a more detailed 
discussion of this matter see a later section. 


(d) The Norms 


The procedure involved in obtaining norms for the 
different designs was quite a complicated one, requiring 
a great deal of careful statistical work. In this effort 


12 INTELLIGENCE MEASUREMENT 


the writer utilized the currently accepted standardization 
‘methods, with but slight modification. An explanation 
of the general procedure utilized, together with a de- 
scription of various methods of checking the results has 


GRAPH 6 


Mental Age Equivalents 
of Score Points 


SCORE POINTS 
= ao 


Courtesy Psychological Review Co. 


been left for a later chapter. Suffice it to say that the 
score points mentioned in Table XXV are to be inter- 
preted in the same light as those of Buckingham in his 
standardization of his Spelling Tests, of Trabue in his 
standardization of his Language-Completion Tests, and 
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of Woody in his standardization of his Arithmetic Tests. 
In this section the final results, merely, will be presented. : 
Graph 6 is the curve indicating the scores to be 
expected at the various ages from 3 years to 19 years and 
6 months. This curve has been smoothed but slightly 


TABLE XXVI 
MENTAL AGE EQUIVALENTS OF SCORE VALUES 


2 


Score | MENTAL MentTAar || Score | MEntTAt || Score | Mentan 


Points AGE AGE PoInts AGE Pomnts AGE 
° StS T3525 99 I5- 9 
or -below 

I 17 FZ=NG 100 I5-I0 
2 6-0 13— 6 IOI Ts 
3 G-13 13-7; Io2 16-9 
4 6- 6 13- 8 103 16-1 
5 6-9 13— 0 IO4 16- 2 
6 7-0 13-9 I05 16-3 
7 y ead: 13-10 106 16- 4 
8 7— 6 13-11 107 16- 5 
9 7-8 I4- 0 108 16-7 
Be) 7-10 14> 1 109 16- § 
II 8-0 py koest IIo 16- 9 
12 8— 2 I4— 2 III 16-10 
13 8-4 I4- 3 112 16-11 
14 8 5 TA—" 4 113 D7 ot 
15 tay TAas5 II4 17-2 
16 &- 9 co ian ee et ee a Yay 
17 8-10 4-7 116 I7- 5 
18 9- 0 I4- 7 TE7, 17- 6 
19 9-1 14- 8 118 17- 8 
20 9- 3 14- 9 119 17-9 
2I Q- 4 I4-I0 120 17-10 
22 9g- 6 I4-II I2I 18-0 
23 9- 8 I5-c 122 18- 2 
24 o- 9 Th On hn t2g 18- 3 
25 Q-II 15-1 124 18- 5 
26 Io- I Is— 2 125 18 7, 
27 Io- 2 i5— 3 126 18- 9 
28 Io- 3 I5- 4 127 18-11 
20 Io- 4 T5— 5 128 Io- I 
30 Io- 5 I5- 6 129 19- 3 
31 Io- 7 el 130 I9- 7 


15- 8 131 IQ-II 
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within the range of ages below 10, though rather con- 
siderably from 15 to 19. This was necessarily the result 
of a deficiency in the number of cases at the higher ages. 
The median score is represented by a circlet placed above 
each age. 

In Table XXVI are presented the mental age equiv- 
alents of each score from 1 (mental age 5 years and 7 
months) to 131 (mental age 19 years and 11 months). 
These values were derived from Graph 6. 


2. THE DIRECTIONS FOR APPLYING THE TESTS 


Preliminaries: Seat the S comfortably at a table, 
noting that his visual angle when working with the 
tests is not less than 45 degrees. Be sure that no designs 
are visible in your preliminary instructions, nor more 
than a single design at any one time. The blocks which 
are not being utilized should be kept in a box, apart, 
so that they are either invisible to the S, or if visible, 
the blocks should be arranged so that the top sides are 
all of the same color. 


Method: Part 1. For Subjects Who Can Understand 
Spoken Language 


(Section A) Take a block. (Instructions to S are 
placed in quotation marks. For design 1 four blocks 
will have been removed from the box.) ‘Here are some 
blocks — give me the name of the color on this side.” 
Sides with the full colors are presented first. Place your 
finger on the side designated. After S has responded, 
turn to another side. “And what is the color on this 
side?’ — ‘Now the color here?” — ‘‘And what is the 
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color here?” — If S has succeeded in naming the colors 
correctly, proceed with the experiment. (If he has 
failed, further instructions are given below, in Part 2.) 
Then the experimenter explains: “Now on this side we 
have blue and yellow (point), and on this side red and 
white (point). And all the blocks are painted in the 
same way.” 

(Section B) ‘‘What you are to do is this: Take these 
blocks” (shuffle them so that when finally placed before 
S, no more than one quarter of the blocks have topside 
colors which are present in the design, the separate 
blocks being placed apart, flat on table, and not piled 
one on top of another), ‘‘pick out the right colors, put 
them together, and make them look, on top, just like 
this” (point to design 1). Give no further hints or sug- 
gestions if the directions have been understood. Caution: 
Be sure that all the blocks are thoroughly shuffled before 
the design is presented. The purpose is to eliminate 
the possibility of studying the design before being ready 
to begin work with the cubes. 

(Section C) If S has not understood what is meant, 
E may perform trial design (A)! slowly, using pantomime 
freely, S watching closely, after which S is requested to 
repeat the operation. This may be repeated any num- 
ber of times until S understands. When he does, proceed 
with the designs in order, beginning at (Section B), and 
continuing with (Section D). 


1 Trial design (A) is represented on the pages with the other designs 
and is used only when under the provisions of Section C further pre- 
liminary explanation is necessary. Trial design A is a four-block design, 
two full white sides above, two full yellow sides below. 
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(Section D) After the first design has been com- 
pleted or failed, the blocks are again shuffled, observing 
the cautions in (Section B), and the S is told again to 
‘“‘take these blocks, pick out the right colors, put them 
together, and make them look on top just like this.” 
(Point to design No. 2.) These instructions remain the 
same for all the designs. The S is not told at any time 
the number of the blocks he is to use. 

Record: Both time and moves are recorded. A move 
is counted when a block is given its initial position on 
the table. Each separate and distinct change in the 
position of a block is counted a move. Sometimes a 
child will make three or four changes in the position of 
a cube, the topside remaining the same color (especially 
true of diagonal sides, e.g. red— white). But each 
change in position is counted a separate move. If 
success is not attained within the time limit, no credit 
is assigned. The time limits are indicated on the design 
cards. 

The whole test is not regarded as complete unless 
there are, ordinarily, at least five consecutive’ failures 
on designs after the last success, and where doubt exists 
as to the inability in the later designs, give as many 
designs beyond the last success as is deemed wise. 


Part 2. For Subjects Who Do Not Know the Names 
of the Colors 

Take all the blocks out of the box and place on the 

table so that the single-colored faces are all on the top 

side of the cubes. Have an equal number of reds, 

yellows, blues, and whites. Point to a red-topped 
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block and ask the child to point to all the blocks that 
have the same color on top. Do the same for the other 
three colors. If the child can distinguish the colors, 
proceed with the test at Section B. 


Part 3. For Subjects Who Cannot Understand Spoken 
Language 
By means of gestures and pantomime go through the 
procedure in Part 2. If S can distinguish the colors, 
proceed with Section C, and through the various designs. 
The method of recording remains the same. 


CHAPTER III 


Standardization Technique 


The Year-Scale Method 

The Percentile Method 

The Point-Scale Method 

4. The P. E. or Linear Projection Method 


Wd 
eA 


The past few years have seen such a rapid develop- 
ment in the technique of scale-making for the purpose 
of measuring mental capacities and pedagogical progress 
that any reasonable discussion of this branch of psycho- 
logical and educational statistics would be entirely too 
extensive and consequently out of place in this mono- 
graph. However, there are four distinct.methods which 
have had more or less ready application and it is to 
these alone that the writer will confine his discussion. 


I. THE YEAR-SCALE METHOD 


This is the method which has been utilized in standard- 
izing the various versions of Binet-Simon Measuring 
Scale for Intelligence. After tests have been selected 
and applied to large numbers of unselected children of 
different ages, each test in the scale is considered sepa- 
rately and the percentage passing the test at the various 
life ages is determined. The fundamental assumption 
is that if a test is a measure of intelligence development, 
there will be an increase in the per cent passing the test 


with increase of age. (Increases due to differences of 
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maturity or experience apart from intelligence, are, of 
course, ruled out.) A criterion which Binet used is to 
locate a test at a specific age if about 75 per cent of the 
children at that age pass the test. Usually the per- 
centage fluctuates between 60 and 85 or go per cent. 
There are a number of distinct objections to this arbi- 
trary procedure, which have been pointed out by A. S. 
Otis! and T. L. Kelley.2 A test, however, is generally 
regarded as most useful which shows the most rapid 
advance with age, and which is placed in the year level 
at which about 75 per cent begin to pass. Although 
the writer recognizes the superiority of the 50 per cent 
criterion, nevertheless to make the results of our year- 
scale comparable with the Binet, we have continued the 
use of the 75 per cent criterion. To have used the 50 per 
cent criterion would have made the tests more difficult, 
because less age credit would have been assigned the 
successful completion of a design in the series. 

The procedure in the use of this performance scale is 
the same as that for the regular Binet, except that for 
those unable to speak or understand verbal directions, 
gestures and imitation are the means utilized to present 
the problem. It is necessary, therefore, that the trial 
design should be utilized before entering upon the exami- 
nation proper. For detailed instructions, however, the 
reader is referred to an earlier section (Part B, Chap. II, 
Section 2). 


1“ Some Logical Aspects of the Binet Scale,” Psychol. Rev., 1916, 23: 
129-152, 165-170. i 

2“ Further Logical Aspects of the Binet Scale,” Psychol. Rev., 1916, 
23: 407-411. 
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2. THE PERCENTILE METHOD 


Because of some important statistical fallacies under- 
lying this method as now utilized — fallacies which only 
one or two have as yet pointed out !— we shall devote 
a rather extended discussion to this procedure. 

The developments in the field of differential psychology 
have doomed forever that much popular slogan: ‘‘We 
are all born free and equal.’”’ The scientific study and 
analysis of individual differences has amply demonstrated 
that a given individual may rank first in one trait, last in 
another, and somewhere in between in another, and that 
this combination of ranks may be different for each 
individual. Thus in a group of one hundred, person A 
may rank t1st in intelligence, roth in motor coérdination, 
85th in general reaction time, tooth in height, and so 
on. Person B may rank 12th in intelligence, 57th in 
motor codrdination, 3d in general reaction time, 7th in 
height, and so on. Person C may present an entirely 
different array of traits. This principle has been utilized 
by the Russian psychologist Rossolimo, for the measure- 
ment and the graphic representation of developed mental 
processes, which he designates the “‘ Psychological Profile 
Method.” ? 


1See J. B. Miner: “Deficiency and Delinquency.” Warwick and 
York, 1918; 355 pp. See esp. pp. 275-270. 

S.C. Kohs: ‘‘Percentile Norms for Scaling Data,” J. of Educ. Psychol., 
1918, Q: IoI—-I02. 

2G, Rossolimo: ‘Die psychologischen Profile. Zur Methodik der 
quantitativen Untersuchung der psychischen Vorgiinge in normalen und 
pathologischen Fallen. Eine experimentell-psychologische Skizze.”” Klin. 
f. psych. u. nerv. Krankh., rorr, 6: 249-294. — English translation: B. 
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Traits may be compared either for their quantitative 
or qualitative differences. At the present time we have 
developed a finer methodology for the former than for 
the latter. Thus our comparisons of one individual with 
another, or of one individual with a group, are largely 
comparisons of a quantitative nature. 


Theoretical Considerations: 


2 


The percentile method or the percentile system is a 
method for determining or locating the rank or the posi- 
tion of an individual within a group. All the members 
of a group are ranked with respect to a given trait, the 
lowest member at one end and the highest member at 
the other. This arrangement is illustrated in Graph 6 A, 
and the curve therefor has been called the “ogive” by 
Galton. Assume, for purposes of illustration, that we 
are studying the heights of 58 four-year-old boys. We 
arrange these measures in increasing order, the lowest is 
866 mm., and the highest is 1165 mm. (See Smedley’s 
Tables.) The curve connecting the separate heights of 
the 58 children is the ogive. Now if we run along the 
base from the 1st to the 6th case, the 6th case represents 
the roth per cent case, and the height at this point is 
called the roth percentile (964 mm.). Twice that dis- 
tance along the base brings us to the 12th case, and the 
height at this point is called the 2oth percentile (968 
mm.). And three times the original distance brings us 


Parker: “The Psychograph of Rossolimo,” Amer. J. of Insanity, 1916, 
73: 273-293. 

See also Titchener Memorial Volume. 

For criticism see Ed. Claparede: ‘Profiles psychologiques gradués 
d’aprés l’ordination des sujets.” Archives de Psychol., 1916, 16: 70-81. 
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to case 17, the height at this point, 997 mm., representing 
the 30th percentile. And so on, for the 4oth, 5oth, to 
the rooth percentile. 

On the basis of this arrangement we may compare 
either two or more individuals for relative positions 
within the group, or we may compare the rank of one 


GRAPH 6A 
The Ogive 


Millimeters 


Heights of 58 four-year-old Boys 
arranged in order from lowest to 
highest. ( After Smedley. ) 


in the light of the ranks of the other members of the 
group. 

With this orientation let us turn to the question of 
tests. The last five years have seen a rapid multiplica- 
tion of graded tests and scales, some intellectual, some 
pedagogical, some involving performance as distinct 
fom those tests involving the use of language symbols. 
With this growth has come the frequent suggestion that 
tests should be evaluated and interpreted in terms of 
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percentile norms, and that we utilize the percentile 
method for grading and comparing individuals. In fact, 
four of the most extensive studies made within recent 
years, by Smedley, by Woolley and Fischer, by Doll, 
and by Pintner and Paterson, have made use of just this 
principle.? 

In the last instance particularly, has the value of the 
percentile method been emphasized: 5 


“The percentile method seems to offer the best possi- 
bilities for future work. The percentile divisions used 
can be made as small as the delicacy of the tests will 
warrant. This method is especially desirable because 
it permits us to compare an individual’s performance 
with the performance of other individuals of the same 
age. It would seem at present, however, to require, for 
purpose of standardization, a very great number of un- 
selected individuals at each age.” (p. 212.) ; 


A fundamental fallacy, however, underlies the present 
practice in the construction and the use of percentiles. 
The quite recent report that the percentile method is 


1F. W. Smedley: “Report of the Department of Child-Study and 
Pedagogic Investigation. 1go0-1901.” Child Study Report No. 3. 
Chicago Public Schools, 1902. 

H. T. Woolley and C. R. Fischer: ‘‘Mental and Physical Measure- 
ments of Working Children.” Psychol. Monogr., 1914, Vol. 18, No. 1. 
247 Dp. 

H. T. Woolley: ‘‘A New Scale of Mental and Physical Measurements 
for Adolescents and Some of its Uses.” J. of Educ. Psychol., 1915, 
Or 521-550. 

E. A. Doll: “Anthropometry as an Aid to Mental Diagnosis.” Re- 
search Publication No. 8, Vineland, N. J. Training School, Feb. 1916. 
QI p. 

‘R. Pintner and D. G. Paterson: “A Scale of Performance Tests.” 
New York, Appleton & Co., 1917. 218 p. 
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not meeting expectations cannot help but reinforce the 
writer’s opinion that the source of the trouble lies perhaps 
in the weaknesses of our present technique. ‘‘The corre- 
lation of the percentile method with the Yerkes-Bridges 
is the lowest of the four methods and at present does not 
seem of much value. Possibly this is due to the compara- 
tively small number of cases tested at each age.” ! 

Among the important cautions to be observed in scale- 
making are two: First, be certain of the zero point; 
second, be sure that the units of the scale are equal. 
This latter is of vital importance where scores of various 
tests in a scale are totaled or averaged, and then eval- 
uated in terms of percentile norms. All percentile 
differences should have a constant, not a variable 
connotation, and each percentile value should repre- 
sent a definite and constant position on the normal 
frequency curve. This is far from true with our present 
technique. 

Perhaps the chief and most destructive criticism of 
the present percentile method for scale construction is 
this: Equal percentile differences on the base of our orgive 
do not represent equal differences in ability between 
individuals. No one will argue that the amount of mental 
ability represented between percentiles 10 and o, equals 
that between 20 and ro, equals that between 30 and 20, 
equals that between 4o and 30, equals that between 50 
and 4o, and so on. In fact, we know from the psychology 
of individual differences that the differences in ability 


1Pintner, R., and Reamer, Jeanette C.: ‘Children Tested by the 
Point Scale and the Performance Scale.” Psychol. Clinic, 1917, 11: 142- 
rst. (parso: 
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of adjacent cases among average, or mediocre, or most 
typical individuals is very small indeed, whereas the 
differences in ability of adjacent cases among extreme 
variates is, on the contrary, very great. 

For a clearer elucidation of this problem we must turn 
to the actual normal probability curve. 

The first clear explanation of the meaning and sig- 
nificance of the normal frequency curve came. through 
the medium of an astronomer, Laplace — a mathema- 
tician, Gauss — and an anthropologist, Quetelet. The 
first two were engaged in efforts to determine the laws 
underlying the occurrence of purely accidental events, 
the last devoted a good part of his lifetime toward finding 
the “average man,” lost somewhere midst a confusion 
of diversity. (It might not be amiss to mention here 
that just in that realm where one would least expect the 
operation of fixed laws, the realm of chance and accident, 
we actually do find a clear-cut subserviency to funda- 
mental laws that definitely determine the frequency with 
which events occur.) 

If we should toss eight pennies (perfectly symmetrical) 
some few million times, then once out of every 256 times 
they would all come down heads; 8 times out of every 
256 times they would come down 7 heads and 1 tail; 
28 times out of 256 they would come down 6 heads and 
2 tails; 56 out of 256, 5 heads and 3 tails; 70 out of 256, 
4 heads and 4 tails; and once out of every 256 times they 
would all come down tails (theoretically). If we plotted 
these data as a column diagram we would obtain Graph 7. 
Or plotted as a smooth frequency curve we could graphi- 
cally represent the above facts as Graph 8. 
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Theoretical Frequency 
8 Pennies tossed 258 times 


Frequency 


GRAPH 8 


Theoretical Frequency 
8 Pennies Tossed 258 Times 
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Laplace and also Gauss derived a formula for the 
theoretical normal probability curve which is given in 
Graph 9. 

GRAPH 9 


The Normal Curve 
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The probable occurrence of the different physical and 
mental traits possessed by human beings also distribute 
themselves, in many instances, in this bell-shaped 
fashion.! Thus, in Graphs ro, 11, and 12, are represented 


1Tn this connection the writer wishes to call attention to an excellent 
article by E. G. Boring: “The Logic of the Normal Law of Error in 
Mental Measurement,” Amer. J. Psychol., 1920, 31: 1-33, dealing with 
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the frequencies of the heights of fifteen-year-old girls, 
fifth-grade ability in arithmetic and the differences in 
the intellectual ability of 905 unselected children ex- 
amined with the Stanford-Binet Scale. 


GRAPH 10 


Heights of 158 
15-year-old Girls 
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(from figures by B.T. Baldwin, p.15, 
“Physical Growth and School Progress", 1914), 


For the purpose which we have set before ourselves 
at the beginning of this discussion, we cannot separate 
the normal probability curve from the ogive. Thus, for 
a given table of data, Table XXVII, Graph 13 is the 
ogive, and Graph 14 the frequency curve, both being 
plotted on the same coérdinates. 
this particular matter, in which he points out the fallacy of a too ,eneral 


application of the “normal curve” to measurements of mental 
phenomena. 
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* Fron Fig 19, Mach: “ Dacstived Poycaiozy,” 1920, p. 35. 
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In these diagrams items are numbered and their 
position on the ogive and on the column diagram may be 
clearly followed. It is of great importance to keep this 
relationship in mind, for in the confusion of the two 
curves lies the fallacy at the bottom of pretty nearly all 
the work in percentile scale making. 


GRAPH 13 


Arithmetic Score 


Arithmetic Score 
aanto wo 


Cases in Consecutive Order 


In Graphs 13 and 14 the crosses on the base of the ogive 
represent equal percentile (decile) differences between 
measures. These may be followed through to the base 
of frequency curve. On the other hand, the arrows 
represent equal units, decile or percentile, on the base 
of the frequency curve, these then are referred back to 
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ogive base. The marked lack of equality between the 
corresponding divisions is quite apparent. It should 
be emphasized that equal distances along the base of 
our ogive cannot, except under a combination of ex- 
tremely unusual circumstances, yield equal distances 
along the base of our frequency curve. But scale values 
must be equal if we are going to equate, add, subtract, 
multiply, divide, or compare percentile scores. It is 
equally true that equal units along the base of our 
frequency curve will not yield corresponding equal units 
on the base of our ogive. 

Another fact which requires mention is this: If we are 
going to determine the ability of a given individual, 
judged by reactions to more than one test, and utilizing 
the percentile method for determining his absolute score, 
then our percentile scale must be made up of score-values 
obtained from the base of our normal frequency curve, 
and not from the base of our ogive. The reason for this 
will be apparent from a study of the normal frequency 
distribution. It is evident that equal distances along 
the base of our normal curve represent equal differences 
in ability. This, unfortunately, is not true for the ogive. 
Consequently, if we take any percentile table in the 
current psychological or educational literature, ability 
represented by the difference between the 1oth and 2oth 
percentiles is far from equal to the ability represented by 
the difference between the 20th and 30th percentiles. 
But this would have been the case if the percentile scale 
. had been laid off on the base of the normal frequency 
curve. These differences in ability represented by differ- 
ences in consecutive percentiles must be equal, if we are 
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going to add, subtract, multiply, divide, equate, com- 
pare, percentile scores. 

To sum up the remarks above: Percentile scales should 
be so constructed that the various steps or units represent 
equal differences in ability. For devising a percantile 
scale, the normal frequency curve should be utilized 
and not the ogive as the base for operations. 


Practical Considerations 

In the following section will be indicated the wide 
divergence of percentile-scale values obtained by present 
methods, and percentile-scale values obtained by sug- 
gested methods. 


Example One 

Smedley, in Child-Study Report No. 3 (1902), Chicago 
Public Schools, gives the following data for Grip of Left 
Hand, Fourteen-year-old Boys (p. 17): 


TABLE XXVIII 


PERCENTILES 


L. Hand Grip 


5I 


30 


This table is merely chosen as typical. Any other might 
have been taken in his report to illustrate the con- 
ditions. 

These percentiles were obtained in the following 
manner: 


“The individual cards on which the measurements 
were recorded when the child was tested were arranged 
according to the size of the pupils in each measurement, 
grouped separately for each age in years. The minimum 
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measurement in each group gave the zero percentile for 
that group. To determine the ten percentile for that 
group, ten per cent of the number of cards was removed, 
beginning at the minimal end, and the highest measure- 
ment on the cards so removed was recorded as the desired 
ten percentile. Similarly the other percentiles were 
determined, the maximum measurement being recorded 
as the one hundred percentile.” (P. 13.) 


It is evident that the ogive rather than the normal 
frequency curve was used to determine percentile values. 
Since 359 cases were used by Smedley, it is a simple 
matter to reconstruct his initial table, which is here 


presented: 
TABLE XXVIIIA 


Lert HAND Grip OF 359 Boys 


No. or | L. Hanp || No. or | L. Hann || No. or | L. Hann No. or L. Hann 
Grip CASES Grip CASES Grip 
24 9 34 2 44 
25 Io 35 | ° 45 
26 8 36 ° 46 
27 8 37 I 47 
28 6 38 ° 48 
29 7 39 ° 49 
30 5 40 ° 50 
31 2 41 I 51 
32 ° 42 
33 ° 43 


The point we have attempted to emphasize in this 
discussion is that in determining percentile differences 
among individuals, the curve of reference should be the 
frequency curve and not the ogive. The table given by 
Smedley is based on differences obtained from equal ogival 
distances. We herewith outline a procedure and present 
a table of percentile differences based on equal distances 
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along the base line of the frequency curve, given in terms 
of standard deviation units or quartile deviation (P. E.) 
units. To find a score, then, corresponding to a given 
percentile, 0, or 10, or 20, and so on, it is merely neces- 
sary to determine the case which falls nearest that 
percentile, then by interpolation to obtain the refined 
score of the case. That value, then, is the score corres- 
ponding to the desired percentile. 

To illustrate: In the above example the range in score 
is from 14.17 to 51.50 (scores refined by interpolation), 
or a difference of 37.33 Kg. The percentiles then, in 
terms of this range, are as follows: 


TABLE XXIX 


RANGE DIVIDED INTO PERCENTILES 


PERCENTILE RANGE VALUE PERCENTILE RANGE VALUE 
° 0.000 60 22.398 
Ace) 3-733 70 26.131 
20 7.406 80 29.864 
30 II.I99 ice) 33-597 
4° 14.032 oo 37-330 
50 18.665 


Now, adding these separate values to the initial score, 
14.17, the final step in the formation of the percentile 


table is taken: 
TABLE XXX 


ScorE VALUES OF PERCENTILES 


PERCENTILE ScorE Score 
° 14.170 36.568 
Rte) 17.903 40.301 
20 21.636 44.034 
30 25.369 47.767 
40 29.102 51.500 
50 32.835 
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For purposes of comparison let us place in parallel 
position the two percentile tables, one obtained by the 
ogive method, the other by the frequency method, and 
then compare the scores. 


TABLE XXXI 
THE Two Score VALUES CORRESPONDING TO THE SAME ‘PERCENTILE 
CoMPARED 
ScorE ScorE 

PERCENTILE OcIvE Frequency || PERCENTILE OciIvE FREQUENCY 

METHOD METHOD METHOD METHOD 

° 14 I4.170 60 28 36.568 

Io 19 17.903 70 30 40.301 

20 21 21.636 80 32 44.034 

30 23 25.369 go 36 47.707 

40 25 29.102 100 51 51.500 

50 26 32.835 


Let us also note the cases which locate the various 
percentiles by the two methods: 


TABLE XXXII 


Tue Cases WutcnH LOCATE THE PERCENTILE BY THE Two METHODS 


CasE NUMBER CasE NUMBER 


PERCENTILE OcIvE Frequency || PERCENTILE OcIvE FREQUENCY 
METHOD METHOD METHOD METHOD 
° I I 215 324 
Io 36 aI 251 350 
20 72 70 287 356 
Our 108 152 323 358 
40 144 226 359 359 


5° 180 289 
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The significance of this new percentile table? lies in 
the fact that the difference in ability between the first 
and 21st cases is equal to that between the 21st and 7oth, 
the 152d and 226th, the 356th and 358th, or the 358th 
and 359th, and so on. By the ogive method percentiles 
are determined by grouping all of one’s cases into ten 
equally numbered groups. By the frequency method, 
however, the number of cases between percentiles is 
markedly unequal, thus in our table the number of cases 
between consecutive percentiles is 20, 49, 82, 74, 43, 35, 
26, 6, 2, 1. These numbers mean that it takes 2 in- 
dividuals at one portion of the distribution to show as 
much difference in ability as is shown at other portions 
by 83, or at another by 20. 

To make the differences between the two methods 
more apparent, the following two figures (Graphs 15 


1Tn the above table for grips, the range in score is from 14.17 to 51.50, 
or 37.33. The arithmetic mean = 26.8 and the standard deviation is 6.46. 


Therefore, each unit of ¢ = 5.78 units of the range es + The total 


range, then, from the o percentile to any other is equal to the sigma 
corresponding to that percentile multiplied by 5.78. Since sigma = 6.46, 
the sigmas corresponding to the different percentiles are 
TABLE XXXIIT 
SIGMAS CORRESPONDING TO VARIOUS PERCENTILES 


PERCENTILE PERCENTILE 
O” Ute e BnkOL000 OOn cel. we Nao 78 
TO), ) 4 OLOn0 Oe | 6 ee See 
20. nek eae 80. Soe eases 
BO) een 8 ei eae QO a: Aer eb ore 
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The same, of course, would hold true for Quartile (P. E.) values. 
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and 16) have been drawn to demonstrate first, the 
differences in score for each of the percentiles, and 
second, the differences in the positions of the individuals 
on the ogive who determine these percentile values. 


GRAPH 15 
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The block designs were not given percentile ratings, 
since it is an open question whether this method is an 
improvement either over the Year Scale Method or the 
P. E. Scale Method, both of which have been utilized 
in standardizing the block designs. In fact the per- 
centile method correctly used reduces this standardiza- 
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tion method merely to a variation of the linear pro- — 
jection method which is discussed later 


GRAPH 16 


Case Locating Percentiles 
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3. THE POINT SCALE METHOD 


A valuable discussion of this procedure (used by 
Yerkes, Bridges, and Hardwick) is found in Pintner and 
Paterson’s ‘‘A Scale of Performance Tests” to which 
we have had occasion to refer in some earlier sections. 
They very clearly point out its shortcomings. The allot- 
ment of points is absolutely arbitrary. There is no guid- 
ing principle, the method is purely haphazard, and the 
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only check is the fear of making the mass of points 
cumbersome and unwieldy. Yet, that point scales are 
desirable is evidenced by the careful work of Otis (Jour. 
of Educ. Psychol., 1918). However, none of the point 
scales now in use are free from statistical and psychologi- 
cal objections which are inherent in the method and can 
only be removed by discarding entirely that sane: of 
standardization. 


4. THE P. E. SCALE METHOD (Linear Projection Method) 


This method has been used extensively at Columbia 
under the direction of Thorndike, and we have adopted 
that methodology with some modifications to a stand- 
ardization of our block designs. The work of Bucking- 
ham in spelling, of Trabue with language scales, and of 
Woody with arithmetic scales, are examples. The chief 
advantage of this method of scaling tests is that each 
test in the series is given a definite weight depending on 
the successes or failures of children at each age. The 
normal probability curve is utilized in determining the 
location of a test on a P. E. Scale, the units of which are 
all equal. Each P. E. Scale has its zero point and each 
test is placed one above the other, depending upon the 
relative difficulty of each. By this means we have been 
able to project each design on a linear scale, each test 
being given a weight corresponding to its position on 
this scale. We were also interested in giving due weight 
to time and moves. For this purpose the times and 
moves for each design were correlated with life age. 
We found a most interesting situation, new to the 
standardizatior of mental tests. In correlating (a) suc- 
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cess or failure in the designs, (b) time, and (c) moves, 
with age, we discovered that with age (a) yielded a 
correlation coefficient of about 80, (b) about 4o, and 
«(c) about 20! In other words, the respective weights 
for success, time, and moves are 4:2:1. Therefore, 
when we obtained the P. E weights for each design, 
time and moves were each given their respective weights 
depending on the initial value of the design. (See Chap. 
IV.) 

Our final standardization includes, therefore, a year 
scale such as the Binet, and a point scale derived by the 
P. E. scale method. The former may be supplemented 
by series of tests which others have standardized; the 
latter is a short scale complete in itself. 

A word in conclusion. Periodically, statisticians 
engaged in standardizing mental or pedagogical tests 
should take stock of their methods, technique, and 
fundamental assumptions. It is an attitude of mind well 
worth cultivating not to regard as final any set procedure 
by means of which scales are at present derived. We 
are, unquestionably, inclined too frequently to forget 
that we are carrying over into education and psychology 
highly refined instruments which are of accepted service 
in biology, chemistry, and astronomy, but may not be 
utilized with the same degree of assurance and finesse in 
those sciences involving the human factor, such as 
sociology, psychology, and education. Well-merited 
criticism has already been launched against our blind 
utilization of correlation formule and of transmutation 
tables, and our incessant worship of the “normal curve” 
fetish. 
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In this chapter on standardization technique the writer 
is well aware of the many weaknesses in the methods for 
which preference is expressed. Until further progress is 
made, however, we must accept what we have with 
scientific caution, subjecting our procedures, at least, to 
- the pragmatic test. 


CHAPTER IV 
The Standardization of the Block-Design Tests 


1. Introduction 
2. Age Standardization 
(a) Mental Age Norms 
(b) Sex Differences (Mental Age Norms) 
(c) Chronological Age Norms 
(d) Sex Differences (Chronological Age Norms) 
(e) Graphic Presentation of Norms 
(f) Final Year Scale 


3. P. E. Standardization 
(a) Method 
(6) Time and Move Norms 
(c) Result: The P. E. Scale 


4. Final Revision 
(a) Eliminations 
(6) Sex Differences 
(c) Final Norms 


I. INTRODUCTION 


Tue block-design tests used for standardization con- 
sisted of a series of twenty designs, graduated in difficulty 
(see pp. 66-67) and a set of sixteen specially colored cubes 
which were given to the S with the request to put the 
blocks, four, or nine, or sixteen, together and have the 
design on the tops of the blocks when complete resemble 


Io2 


BLOCK-DESIGN TESTS 103 


the design as indicated on the card set before him. In 
this manner we had hoped to carry over into performance 
tests Ebbinghaus’s idea of a ‘‘ Kombinations-methode.” 
In this we were doing no pioneer work, having been pre- 
ceded by Healy, Knox, and Pintner, but this particular 
combination of method and apparatus is new. The cube 
material is described more in detail in Chapter II, Sec- 
tion I. ‘ 

Every one who has been given the test, from the young- 
est child to the adult, has manifested a keen interest in 
manipulating the material. There seems to. be some 
fascination about performance tests in general which it 
would indeed be interesting to fathom. The directions 
which were given the S’s have already been stated in full 
elsewhere. (See Chapter II, Section 2.) A record was 
kept of success or failure, enough time being allowed for 
success if that seemed at all possible, and our final results 
show, in fact, that we were too lenient to the extent of 
anywhere from a half-minute to a minute in the case of 
each design. The final time limits have all been reduced 
as a result of our findings. The original time limits for 
the designs, upon which success or failure mentioned in 
the succeeding tables was based, were: 

Designs I-IX, 21 minutes 
Designs X—XI, 3 minutes 
Designs XII-XVII, 4 minutes 


Designs XVITI-XIX, 414 minutes 
Design XX 5 minutes 


Moves and time were both recorded, the latter in whole 
seconds. These two factors, however, did not here 
affect the score: “‘passed” or “‘failed.”’ For an explana- 
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tion of what was considered a move, see previous section 
on directions for applying the tests. 

In the final standardization by the linear projection 
method three designs, XI, XIII, and XVII, were omitted 
and the others were assigned the following Arabic num- 
erals: 


DesignI now Designr DesignIX now Design 7 
iz3 cc Ke “e “cc Io 


IL iT3 ce 2 
(<9 IIL (73 cc 3 “ee XII cc cc II 
(73 IV ce ce 4 “ec XIV cc “ec 14 
“ce Wi if3 cc 5 ce KV. “cc “cc I2 
6c VI ce “ce 6 “cc ara f ““ ce 13 
cc VIL “cc “ 9 cc XVIII “cc “ 15 
6c VIII oe cc 8 cc dt RE “cc “ 16 


Design XX now Design 17 


2. AGE STANDARDIZATION 


We shall utilize both chronological and mental age 
standards in assigning age values to each of the designs. 
Some may object to the use of mental ages for standard- 
ization, but we have found no valid reasons for rejecting 
this criterion; in fact there are obvious reasons for its 
utilization. First, it serves as a check on an impartial 
selection of children —if they happen to be somewhat 
retarded or accelerated, the mental age difference will 
weight the norms accordingly. Secondly, we wish to 
translate our norms in terms of Binet mental age, so that 
a mental age obtained by this performance scale will 
possess the same significance as a Binet mental age. 
Nevertheless, Pintner and Paterson! maintain “Why 
should we know the mentality of the children we are 


1“ Scale of Performance Tests,” p. 52. 
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testing? What we want to arrive at is the ability of 
children of a specific age on a certain test, and we ought 
not to be influenced by other estimates of their ability. 
Our sole endeavor must be to get a fair sampling of cases 
at each age. If we standardize according to mental age 
arrived at by any scale, we are moving in a circle and 
presupposing that our determination of mentality is 
accurate and final.” That we do not move in a circle, 
however, is clearly evident from the close correspondence 
between the chronological and mental age norms as 
indicated in the graphs. And the attempt to obtain a 
“fair” sampling at each age is rarely a statistical success. 


(a) Mental Age Norms 

We have utilized here the reactions of three different 
groups, (1) the whole P.S.! group, (2) the F. M.? and the 
P. S. groups, and (3) a group consisting only of children 
having I. Q.’s between 86 and 115. In this manner, the 
children of I. Q.’s between 86 and 115 have weighted 
our mental age norms to an extent of 3, the rest of the 
P. S. children, the accelerated and retarded, to an extent 
of 2, and the F. M. group to an extent of 1. This reduces 
any defect in the norms obtained because of the possible 
inaccuracy of the Binet scale in a few cases, this inac- 
curacy being more likely to occur with the so-called 
F. M., the seriously retarded, or the greatly accelerated. 

Tables XXXIV, XXXV and XXXVI give the num- 
bers and per cents passing for each of the sexes and as a 
total for the whole P. S. group. (Age 4 on the table 
includes ages between 3 years 7 months and 4 years 6 
months, and so on for each age.) 

_ 1 Public School. 2 Feeble-minded. 
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Table XXXVII presents the data for the per cents 
passing at each mental age, the group here being limited 
to those only in the P. S. group whose k Q.’s ranged 
between 86 and 115. 

Table XXXVIII gives the per cents passing at each 
mental age, combining the F. M. with the total P. S. 
group. 

In Table XX XIX. is presented a composite of the data 
in Tables XXXVI, XXXVII and XXXVIII, the arith- 
metic mean being used. It has already been mentioned 
that as a result of this procedure the I. Q. norms receive 
a weight of 3, the norms for the P. S. children under 
86 I. Q. and above 115 I. Q. a weight of 2, and the 
norms of the F. M. group a weight of 1. The figures for 
each of the designs in this table were utilized for the 
final mental age graphs showing perYJcents passing at 
each mental age (Graphs 17 to 36). 

A matter which should be observed in connection with 
the composite norms is the fact that the children falling 
in the 13-year (mental age) group, are the only ones 
which do not manifest a consistent superiority over the 
children of the next preceding age. It is true that in 
many instances the difference is no more than 3 or 4 per 
cent in either direction. But not only should this slight 
negative difference not exist, but the 13-year-olds should 
show marked superiority over the 12-year-olds. Biased 
as all devisers of tests are in favor of their own scheme 
of mental examination, the writer might now justifiably 
follow the custom of throwing the blame on the Binet 
tests. In this attempt, however, he is handicapped by 
too many years’ actual experience with the Scale, during 


Mental Age 
~~--Chronological 
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which period he has developed no little regard for its 
accuracy. The same inadequacy of the 13-year-old 
group, though to a less marked degree, is observable in 
the table giving the chronological age norms. 


(b) Sex Differences (Mental Age Norms) 


Table XL summarizes the data for sex differences 
at ages 6-8, 9-13, and 14-19. This division is merely 
one of convenience, dividing the range of mental ages 
into approximately three equal parts. In this table 
are presented the number of times at the various ages 
for all of the designs that the boys show a greater 
percentage of passes than the girls, in the next row the 
number of times that this is true for girls, and the last 
row the number of times when the per cent passing is 
equal for the sexes. This number of equal per cents 
passing is great because o per cents and roo per cents 
passing have been included. 


TABLE XL 
Sex DIFFERENCES 


MENTAL AGES 
Toran 
9-13 14-19 


Number of instances in which 
per cent of boys pesae is 


greater than girls . 53 23 87 


Number of instances in which 
per cent of girls passing is 


greater than boys . 35 18 66 


Instances of no difference in 
per cent passing between is 


and girls I2 79 127 


Total . 
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The data of Table XL is summarized more briefly 
and for per cents in Table XLI. It will be evident that 
no marked sex differences are observable here, the boys 
appearing somewhat more superior than the girls. This 
will be corroborated again at a number of other points. 


TABLE XLI 
Sex DIFFERENCES 


2 


PERCENTAGE OF 


NUMBER TOTAL 
Instances boys superior to girls . . . 87 ches 
Instances girls superior to boys . . . 66 23.6 
UG are cai bot ogi Tsu Sragh Se <e 127 45.3 
Total ee Ma ER Gol calgon ss (,3 280 100.0 


Table XLII presents this evidence again for the first 
ten designs, and for the last ten, and for the total. 


TABLE XLII 
SEx DIFFERENCES 


MENTAL AGES 


Desien No. 6-8 9-13 14-19 


Number of instances 


boys superior . .| 8 3 | 24 |} 20 3. | 20 52 
Percent . .| 27%] 10%| 48%| 58%] 5%) 33%l 25%| 37% 
Number of instances 
girls superior . .| 13 One Ou 7: Fp a| ek Wactsy Caer 
Percent . .| 43%| 0%] 36%| 34%! 12%| 18%) 27%| 20% 
Number of instances 
equal Zh ee er 8 4 4| 50° | 29167 | 60 
Percent . .| 30%| 90%] 16%] 8%] 83%| 40% 48%] 43% 
Motalee ss FesO 1 5sOun | 508 050%) 260" ("60 140 


Percent . .|100%|100%|100%|100%]100%|100%|100%| 100% 
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In designs I-X, ages 6-8, girls seem superior, with no 
significant sex difference on the last ten designs. Be- 
tween the ages 9-13, boys seem superior throughout. 
Between the ages 14-19 there is a good deal of equality, 
though girls are somewhat superior on the first ten and 
the boys on the last ten designs. In designs XI-XX, 
boys are superior at each of the grouped ages. On de- 
signs I-X girls are superior at each of the grouped ages 
except 9-13. From the table it is clear that in the early 
ages, from 6-8, there is no observable sex difference, 
perhaps’ girls may be said to be slightly superior, from 
9-13 boys are somewhat superior, and from 14 to 19 
boys are only slightly superior, with marked equality 
between the sexes at this age group. 


To summarize the data for the sexes: In designs I-X, 
ages 6-8, girls are superior; ages 9-13, boys are superior; 
ages 14-18, girls are again superior. In designs XI-XX 
boys are superior at every age group. In the first ten 
designs the girls are superior, in the last ten the boys are 
superior. Perhaps the mechanical, somewhat puzzle- 
like nature of the later designs may help account for 
this difference. Taking the data in Table XL for all the 
designs, there is no significant sex difference from ages 
5-8; between 9-13 and 14-18 boys seem superior. 
Combining all the tests and all the ages, the boys are 
slightly superior. It should be understood by the reader, 
however, that these tables merely show tendencies and 
are not to be interpreted as conclusive evidence for any 
valid argument relative to intelligence differences be- 
tween the sexes. 
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(c) Chronological Age Norms 


In obtaining these values we utilized only the P. S. 
cases, discarding all those who were not in the normal 
grade for their chronological age, or not within one 
year of normal grade. This yielded some 241 cases (121 
boys, 120 girls) upon which these norms are based. 

In Tables XLITI, XLIV, and XLV are presented the 
number and per cents of boys, of girls, and of the total 
number at each age passing each of the designs. The 
range in chronological age is smaller than the range in 
mental age, as would naturally be expected, the lowest 
chronological age falling in the 6-year group and the 
highest in the 17-year group. This yields a range of 
twelve years. 

Attention should be called to the striking similarity 
between the tables for mental age and the succeeding 
tables for chronological age. There are no marked dis- 
crepancies in spite of the fact that the mental age tables 
included reactions from the feeble-minded, which would 
theoretically produce some disturbing effects. 

The adequacy of the sampling and the validity of the 
standardization is also positively indicated by the close 
agreement between the respective tables for mental age 
and chronological age. Although the standardization 
technique for chronological age compels a reduction in the 
number of cases under consideration to 241, an elimina- 
tion amounting to thirty-three per cent, nevertheless the 
figures obtained from this smaller and, in some respects, 
more homogeneous group, agree very closely with the 
figures of the preceding section, based upon mental age 
and on the total 366 cases. 
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(d) Sex Differences (Chronological Age Norms) 

Table XLVI analyzes the sex differences in the differ- 
ent age groups for the first ten designs, for the last ten, 
and for the total. 

TABLE XLVI 
Sex DIFFERENCES 


CHRONOLOGICAL AGE 


Desicn No. 6-8 9-13 14-17 ~ 


Number of instances 


boys superior . .| 8 Bae 28 Alear 6 
Percent . .| 27%| 7%| 56%) 62%| 20% 
Number of instances 
girls superior . .| 14 Ee ebOn ror aaa. 
Percent . .| 46%! 3%] 32%| 32%| 47% 
Number of instances 
CUAL Nos sss eS 27 6 3 IO 
Percent . .| 27%| 90%] 12%| 6%| 33% 
Dotaleme ee) = es0Nn | 120) 450, 150) 150. 
Percent . .|100%|100%|100%|100%|100%|100%|l100%|100% 


It will be observed that girls are superior in designs I-X 
at ages 6-8 and 14-16, the boys being superior at ages 
9-13. On the whole, for the first ten designs the girls 
are slightly superior. The boys are superior on designs 
XI-XX at all the age groups. Taking all the designs 
together, girls are superior at the earlier ages, boys be- 
coming superior at about nine and remaining so there- 
after. On the whole, it appears that boys are superior 
in these designs to the girls. These results based on 
chronological age confirm the findings by mental age. 
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Further analyses for sex differences have been made 
by means of a tabular comparison of results obtained 
(a) for the mental age (total P. S.) group, (0) for the 
mental age (selected I. Q.’s) group, and (c) for the 
chronological age group, by years below 9, between 9 and 
13, and above 13. These data are not here presented, 
but may be constructed from the tables already given. 
It is evident (a) that for ages below 9, girls are slightly 
superior to the boys, this being especially true for the 
first ten designs. For the next ten designs there is no 
appreciable difference, the same being true for all the 
designs for children below nine years of age. (6) For 
ages 9-13, boys are superior to girls on all the designs 
and much more so on the second set of ten than on the 
first set. And (c) above age 13, boys seem slightly superior 
to girls, but on the first ten designs girls are superior to 
boys, while on the last ten, boys are quite superior to girls. 

Considering merely designs I-X, and allowing for 
errors of sampling, we may say that there are no sig- 
nificant differences between boys and girls, but as regards 
designs XI—XX, with increase in age, boys seem superior 
to girls. Whether this difference is due to a difference 
in analytic synthetic power, or whether it may be largely 
accounted for by specialized mechanics on the part of 
boys, cannot be stated dogmatically. Then, again, 
whether this evidence would change with the addition 
of further samplings cannot be definitely foretold. 


(ec) Graphic Presentation of Norms 


With the data then of Tables XXXIX and XLV we 
may plot our curves for per cent passing with increase 
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of mental and of chronological agé. This has been 
done in Graphs 17 to 36. Jt should be noted that the 
mental age and chronological age curves overlap, and if no 
key had been presented stating which is which, no one would 
have been able to tell them apart. Many have been the 
warnings not to standardize a test on the basis of mental 
age, nevertheless the results are practically identical. 


(f) Final Year Scale 


Our final year-location of a test has been determined 
by combining (averaging) the two curves, mental age 
and chronological age. See Table L. Using the 50 
and 75 per cent criteria, the designs are located at the 
ages stated in Table XLVII. Table XLVIII presents 
this material in another form. And Table XLIX gives 
the scores in designs successfully completed at the various 
age levels. Graphs 37 and 38 present the data graphi- 
cally, and we have here added in Graph 39, for purposes 


TABLE XLVII 


YEAR ScALE Norms 
(Based on a composite of mental and chronological age norms) 


AGE VALUE AcE VALUE 
DESIGN 50% 78% DESIGN 50% 75% 
CRITERION CRITERION CRITERION CRITERION 
Yrs.Mo| Yrs. Mo Yrs. Mo Yrs. Mo 
I 6-o 6-9 XI 3-0 18-0 
igi 7-0 8-6 XII 13-0 15-3 
Til 78 8-3 XIII 15-0 16-3 
IV 9-3 10-6 XIV 13-6 16-0 
V 9-3 10-3 XV 15-0 16-0 
VI 10-0 12-6 XVI 13-3 15-9 
VII 13-0 16-0 XVII II-3 15-0 
VII 10-3 13-3 XVIII 14-0 15-6 
IX 10-3 12-9 XIX 15-6 17-6 
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TABLE XLVIII 
Year ScALE Norms 


DeEsicn NUMBER 


AGE 
50% CRITERION 78% CRITERION 
Giehreceea rs uf I 
y cea II Ii 
bs cea ps Se some ees 
OM eores IV V 
FOUL cass Vileo Vries IV V 
II Stee XVII 
Eo sere ca hs VI IX 
Tet ceed tet at VLE ate CRY eo VEE VIL 
LAGH sae Venepeshies D Some Afi Ob 
MGhaees. ase ees XII XV XIX XII XVI XVII XVIII 
TOMS Reiss ics XX Vib XX av Soy? 
TP rpereeel sae XIX KOE 
LOae a eas hie D.4 I 
TABLE XLIX 
SCORES TO BE EXPECTED AT THE Vartous AGE LEVELS 
AcE CN Re Ace oe hates 
4 ° ° 12 fe) 7 
5 ° ° 13 14 8 
6 I I 14 16 8 
7 3 I IS 19 I2 
8 3 3 16 20 17 
9 5 3 17 20 19 
5 ke) 8 5 18 20 20 
II 9 5 


of comparison, the location of these designs on a P. E. 
Scale, the derivation of which is explained in the division 
on “P. E. Scale Norms.”’! 


1It should be noted that although the original time limits for each 
design were somewhat longer than the later revision, the revision itself 
covers practically the same amount of time in which success may reason- 
ably be expected. The validity of the above-indicated norms are, 
therefore, in no way affected by this change. 
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GRAPH 37 


Age Location of Designs 
(50% Criterion) 
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3. P. E. STANDARDIZATION 
(a) Method 

For a full and detailed explanation of the principles 
underlying the scaling of tests on a P. E. basis and for 
the technique involved, the reader is referred to the work 
of Buckingham, Trabue, and Woody. Here, let it 
suffice to mention that by means of this method, each 
test in the series is weighted, first, depending on the P. E. 
intervals between the separate ages, and second, depend- 
ing on the ratios between the number of passes and 
failures. In Table L are presented the per cents passing 
each design at the various ages from 3 to19. (This data 
is based on the age norms, mental and chronological, 
smoothed.) In Table LI are presented the differences 
between 50 per cent and the per cent passing a design 
at each age. The data are thus prepared for the use of 
Sheppard’s Tables,! and in Table LII are accordingly 
presented the P. E. equivalents of the items in Table LI. 
In Table LIII are presented the P. E. intervals between 
consecutive ages, the bottom of the table showing the 
average intervals between consecutive ages. In Table 
LIV are tabulated the distances of each age median 
above the zero of the P. E. scale. The separate age- 
distributions are presented graphically in Graph 40. 

It should be stated that a few minor modifications have 
been made in the application of this method to our prob- 
lem. These changes have been in the direction of elimi- 
nating some of the super-refinements. In theory and 
result the method has been kept intact 


1See Appendix ITI. 
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TABLE LIV 


Distances ABOVE ZERO OF THE MEDIANS OF EACH AGE 


Bretow NExtT 


AGE ABOVE ZERO Hicuen Ace 
4 ? Y 
5 ° 3.1 
6 YG rey 
7 4.8 9 
8 5.7 I.I 
9 6.8 any, 

be) ae oS 

II 8.0 a3 

I2 8.3 a3 

13 8.6 Se 

14 8.9 aC 

15 9.4 1.0 

16 10.4 1.6 

17 12.0 1-2) 

18 13.2 1.8 

19 15.0 


The reader’s attention is called to two matters of 
importance in the above standardization. First: Any 
age-group which manifested a difference between 50 
per cent and the per cent passing at each age of plus or 
minus 50 per cent (see Table LI), was located on the P. E. 
Scale at 4.6 P. E. above or below the median for that 
grade. Itis admitted that 4.6 P. E. is an arbitrary figure, 
but in this the writer has followed the custom of his prede- 
cessors. Second: The basic assumption underlying P. E. 
standardization has always been that distributions of 
mental ability follow the normal curve. Attention has 
already been called to the criticism launched by Boring 
against this hypothesis. We must admit acertain degree of 
error in our standards because of this peculiar inadequacy 
of our standardization technique, and yet we need not 
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hesitate to use the results thus ecunea, if we are at all 
times fully aware of their shortcomings. Until better 
instruments for norm-setting are placed at our disposal, 
we must utilize the best methods we now possess. 

It may not be out of place here to call attention to a 
common fallacy, frequently observed in the writings and 
the methodology of present-day devisers of tests, which 
pertains particularly to the matter of “weighting.” 
The situation is strikingly evident in group testing. For 
example, take one recently devised group-test for mental 
ability. It is a booklet containing six exercises. Exer-~ 
cise One is a list of questions. The answers ‘‘Yes-No” 
are tabulated in a column at the right. The child per- 
forming the test is asked to read the questions carefully 
one at a time and draw a line under the right answer to 
each question. This question-exercise consists of forty 
items graded in order of difficulty. (Question 1 is, “Do 
dogs run?” — Question 40 is, ‘‘Are judicial decisions ever 
enforced?”) Exercise Two, however, consists of only 
twenty arithmetic problems, also graded according to 
difficulty. (Example 1 is, “How many are 30 men and 
7 men?” and example 20 is, “‘A submarine makes 8 miles 
an hour under water and 15 miles on the surface. How 
long will it take to cross a 100-mile channel, if it has to 
go two-fifths of the way under water?”’) A time limit of 
five minutes is allowed the pupil for each of these two 
exercises. The unfairness in the scoring lies in the fact 
that in adding up the total score each question success- 
fully answered in Exercise One has equal value with.each 


1 Haggerty, ae yogis Examination,” Delta 2, World Book Co., 
1920. : 
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question successfully answered in Exercise Two. It is 
true that no attempt has been made to weight these 
exercises. And the impression becomes fixed that no 
weighting is better than one even crudely constructed. 
This was the apparent decision of the committee which 
drafted the Army Tests. 

The reason for mentioning this matter here is to justify 
the writer’s procedure in attempting some sort of weight- 
ing process for each of the designs, and not only as re- 
gards successful performance of each of the designs, but as 
well for the time spent and the number of moves made on 
each design. It is the writer’s contention that some 
rational and statistical basis for weighting is to be pre- 
ferred to no weighting of any sort. 

To come back then to our illustration. In the above- 
mentioned group-test a child may answer twenty ques- 
tions in Exercise One during the five minutes allowed, 
but in Exercise Two, the arithmetic problems, he may 
barely pass eleven. In summating the total score 
achieved, the answers to the questions inevitably have 
twice the importance as compared with the answers to 
the arithmetic problems. In other words, an item in 
the list of arithmetic problems has about half the 
weight of an item in the list of questions. In view of the 
lack of information on this particular matter, there seems 
to be no rational or statistical basis for this apparently 
arbitrary number of items in each exercise. 

It is the writer’s contention, therefore, that some 
reasonable attempt at weighting separate tests in a 
series is justifiable; that there is no escaping some sort 
of weighting; and that between the two evils of no 
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weighting at all, and one rationally’ and statistically 
arrived at, the latter certainly is to be preferred. 

In standardizing the block designs by the P. E. Scale 
Method, the writer has not followed exactly the orthodox 
procedure of Buckingham, Trabue, and Woody. If we 
keep in mind the fact that educational statistics per- 
taining to mental or pedagogical achievement are in- 
clined to be far less accurate than physical or chemical 
statistics, it seems unnecessary to utilize extra refine- 
ments of standardization in order to obtain satisfactory 
and workable norms. It would, perhaps, be no exaggera- 
tion to state that we have erred as frequently in over- 
refining our statistical procedures as in not refining them 
enough. 

Another matter worthy of note is that in the block- 
design tests the intervals between consecutive ages are 
not equal. The assumption frequently made is that 
increments of mental ability between ages are equal. 
The progress of the intervals for block-design ability is 
indicated in Graph 41. It appears that the differences 
are far more apparent between the ages 4 to 11 and 14 
to 19 than between the ages 11 to 14._ The elimination 
of a few designs in the middle range, from designs 5 to 
15, might remedy this fault, if such it be. 

The zero point on our P. E. Scale is very easily located 
from the tables of data. It is the age at and below which 
no children pass a given design. 


1The writer does not wish to be understood as adversely criticizing 
the Haggerty Intelligence Examination. The tests, as such, are excellent, 
but I am convinced that even their author would admit that the norms 
and methods of scoring are open to improvement. 
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GRAPH 41 

Location of Age Medians on 
P. E. Scale 

(Showing Size Relation of Intervals ) 
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Table LV may then be constructed from the data of 
Tables LII and LIV, giving the location above zero 
P. E. of each design at each age. In the last column to 
the right (Table LV) are given the final P. E. values of 
each design, obtained by averaging the findings for that 
design at the various age levels. We differ, again, at 
this place in our procedure from that followed by Thorn- 
dike’s students, by not rejecting any of our individual 
P. E. values, and by giving each value equal weight. 

Graph 39 is a pictorial arrangement of the twenty 
designs on the P. E. Scale. 


(b) Time and Move Norms 


As has already been stated, the writer felt in the very 
early stages of the standardization process, that time and 
number of moves were very important diagnostic criteria 
which could not conscientiously be left out of considera- 
tion in the final assignment of a score for a specific per- 
formance. Hoping for some clue whereby the three 
criteria: successful performance, time, and moves, could 
be amalgamated satisfactorily in a single score-value, 
the record of every test made contained a complete 
statement of these three reactions for each design. It 
was difficult in the preliminary stages of the investiga- 
tion to state dogmatically which of the three criteria was 
most and which least important. But at the conclusion 
of our experimentation sufficient objective evidence had 
been accumulated to answer these questions more or less 
adequately. . 

One clue which seemed more worth while developing 
than any other was the relation between the above- 
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mentioned three criteria and life age. (Mental age 
would, undoubtedly, have served as well.) If success, 
time, and moves were diagnostic tools of varying im- 
portance, it seemed plausible that these differences would 
become apparent if correlated either with life age or 
with mental age. 

This was therefore done with the following somewhat 
startling results: 


CORRELATIONS 
Life Age and Raw Scores (241 Cases Public School Chil- r IID 
dren, “‘at grade’’) +.71, +.02 


Life Age and Time (Averaged first the individual co- 
efficients and then the indi- 
vidual P. E.’s for each of the 
twenty designs. Note: Only 
those coefficients were used 
where r was at least four times 
the P. E. The results for five 
designs were therefore not 
used. See Table LVIL.) +.38, +.06 
Life Age and Moves (Averaged the individual coeffi- 
cients for r and P. E. as above. 
Note: Only those coefficients 
were used where 7 was at least 
twice as large as the P. E. The 
results for six designs were 
therefore not used. See Table 
LVIL.) +.20, +.07 
Binet Mental Age and Raw Srores 
(366 cases. Included are all the 
subjects of this study.) +.82, +.01 


From these figures it was possible to conclude for this 
test that success, as such, is about twice as important a 
diagnostic criterion as time (ratio 71 to 38), and that 
time is about twice as important as moves (ratio 38 to 
20). In other words, giving moves a value or a weight 
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of 1, time should, according to the above ratio, receive 
a weight of 2, and success a weight of 4. It is this re- 
lationship that is referred to when the ratios 4: 2:1 are 
stated in various sections of this monograph. 

Scientific attitude precludes the existence of bias. 
Nevertheless, it is the rare experimenter who can count 
himself free from all sorts of fixed notions. The writer’s 
conception of the relative importance of time and moves 
squared with the prevalent opinion that moves are more 
important diagnostic-indicators of intelligence than 
time. The poor correlations between “speed” tests 
versus “power” tests helped confirm this belief. Be- 
sides, it had come to be accepted that to attempt the 
combination of such utterly diverse entities as success, 
time, and moves was nothing short of quixotic. 

In presenting the above figures there has been no desire 
to enter into a controversy with common opinion. The 
facts are presented as facts, and as such should receive 
their requisite evaluation. The writer knows of no other 
instance where an attempt has been made by similar 
impersonal methods to determine objectively the weights 
to be accorded the three intelligence-criteria mentioned 
above, and will await with interest the efforts of others 
in this direction. 

The correlation between life age and the raw scores 
(the factors of time and moves not having been taken 
into consideration) is presented in Table LVI. (All of 
the correlations in this monograph have been determined 


by means of the formula: r= ~——~__—., modified 
N2e VY 33 
by the writer. See Appendix IT.) 
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TABLE LVI 
Lire AGE AND Raw Scores CorRELATION 


DEsIGNs Lire Acr 
CoMPLETED 
Of 7 1.8 | oO ro] 28) x2 | x3.) ra} xy] 36 

° Set Wie 1 (ids Saal he Sc 

I 24.814 2 | 2 0 a ae 

2 Soa Geel 

3 ode al a Nea haa 8 Tx I 
4 Som ee tna ya? Es fade od a 
5 2)}31)4]4 4 2 
6 PAS Heat eset ae ee Oe 2 
vf Teleel ee esas Fost ie se. tes 

8 2 1 4S Ooh SS ay Pe) I 
9 pA ea een Ne oy Fee as Se Ia 
Bie) yah Wier an bay Tel 
II = eal cep PON NS oak BS 
12 rae Veg a) eee) Pe ga ea I 
13 x Sale I + 
14 2 dy Wee al pean fee 
15 a aS I 
16 if | a3 I 
17 ia oe GERI Lae Si ee i de So Up MWe fo 
18 Ze eee |e 
19 te bea awed abe! all ea 
20 al CP tier} 


Total . |r5 126 |28 |24 128 \25 |22 |22 |23-1x5 |xx 


r=+.71 P.E. = + .02 


The 241 children included in Table LVI were only 
those of the public school group who were located at the 
proper grade for their life age. 

The correlations between life age and time and be- 
tween life age and moves for each of the twenty designs 
is presented in Table LVII, together with their respective 
probable errors. All the correlations are positive, except 
where otherwise indicated. 

In the fourth and eighth columns of the table are pre- 
sented the ratios between the coefficients for time and 
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moves for each design. These ratios are finally averaged, 
with the result that time appears a better diagnostic 
criterion than moves to the extent of 2 to 1. In aver- 
aging the coefficients for life age and time the results for 
Designs VIII, X, XVI, XVIII and XX were not in- 
cluded, because their coefficients were less than four 
times their P. E.’s. And in averaging the coefficients 
for life age and moves, the results for Designs VII, VIII, 
X, XVIII and XX were not included, because their co- 
efficients were less than twice their respective P. E.’s. 
Consequently in averaging the final ratios for time and 
moves the ratios for Designs VII, VIII, X, XVI, XVIII 
and XX were not used. : 

No other methods have been utilized to check the 
validity of this procedure for determining the relative 
weights to be apportioned success, time, and moves. 
However, the method outlined above is objective and 
free from personal bias. 

As regards sex differences for time and moves, there 
were no greater differences apparent than might be 
expected from the expected errors of sampling. 

To go on then to the separate norms for time and for 
moves, in Table LVIII are found the figures for the 
average times (arithmetic mean), and in Table LIX the 
average moves for each design at each chronological age, 
from 6 to 17. Thus for Design I, at age 6, 72 seconds 
are taken for successful completion, as compared with 
22 seconds at age 11, and with only 7 seconds at age 17. 
And again, for Design XIX, at age 9, 258 seconds (over 
4 minutes) are necessary for successful completion, as 
compared with 171 seconds at age 14, and only 99 seconds 
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at age 17. So, too, for moves. For Design I, at age 6, 
8.9 moves are made before success is finally accom- 
plished, as compared with 5.6 moves at age 10, and with 
4.6 moves at age 14. And again, for Design XIX, at 
age 9, 42.0 moves (almost 3 moves to each block) are made 
before the design is successfully completed, as compared 
with 28.9 moves at age 14, and only 21 moves at age 17. 

An analysis of sex differences reveals the following: 

For designs I-X, ages 6-8, the tendency is greater 
for boys to give longer times on the same designs, 
although the frequency for giving long reaction times 
is about the same for both groups. For designs I-X, 
ages 9-13, boys more frequently exceed the times of the 
girls (ratio: boys, 31; girls, 18), but the amount of ex- 
cess is about the same (ratio: boys, 15”; girls, 18”). 
For designs I-X, ages 14-16, and for designs XI-XX, 
ages 9-13, no tendency is evident for boys to exceed 
girls in time per design. or vice versa, the excess being 
about the same. And in designs XI-XX, ages 14-16, 
boys more frequently give longer times (ratio: boys, 24; 
girls, 6), but the girls give longer times whenever they 
exceed in time (ratio: boys, 27’’; girls, 34’). In general, 
it may be stated that boys tend to give longer reaction 
times more frequently than girls, but when girls take 
longer the excess in time is greater than the excess in 
time for boys. 

As regards sex differences in moves, there are no ap- 
preciable differences except for designs I-IX at ages 6-8, 
and 9-13. In the first instance, the tendency to make a 
greater number of moves is about the same, but the 
excess is greater for boys than for girls; and in the latter 
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case, the tendency to make a greater ’number of moves 
is stronger for boys than for girls, but the excess of moves 
is about the same. 

Tables LX, LXI, and LXII give the correlations be- 
tween time and moves for the four-block, nine-block, and 
sixteen-block designs. The correlations are high, as one 
would expect. 


TABLE LX 
CORRELATION BETWEEN TIME AND Moves 
(4-block designs) 
TmE 
Moves TOTAL 
17-30" 317-1" =| 1’n7-1'30"| 1/31°-2’ | 2’1°-2'30" 

4 140 Io I ISI 
5- 8 192 90 8 3 I 204 
Q-f2) 13 Io 27 6 4 60 
13-16 . 3 18 II 7 39 
17-20 . Io 8 6 24 
21-24 . 6 2 7 15 
Or—OSn a 3s I I 2 
20-325, 2) I I 2 4 
33 and over . I I 
Total : 345 113 71 32 29 590 


r=-+.76, + .o1 


Four groups of workers may be segregated from these 
figures by horizontal and vertical divisions of the tables. 
One group which works rapidly and accurately, and con- 
sists almost entirely of those who succeed. A second 
gfoup which works somewhat too rapidly perhaps, and 
attempts numerous varieties of block-combination. A 
third group which works slowly, makes few moves and 
appears deliberative in procedure. And a fourth group 
which not only works slowly, but also attempts numerous 
combinations, many bordering on the irrational. 
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TABLE LXI 
CoRRELATION BETWEEN TIME AND Moves 


(9-block designs) 


TIME 


7-2! 2'1 "= 2". -g0" | gz "ex" [1/2 "-2"30"|173x "-24| 2's "2°30 "2°31 °-3413°2 "3" 30°13’3x a "31 "-3/13’1 °-3’ 3013/31 7-4 


7=+.58, + .04 


TABLE LXII 
CoRRELATION BETWEEN TIME AND Moves 


(16-block designs) 


TIME 


TOTAL 


Hon OoNWH NH 


r= +.70, + .03 
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(c) Result: The P. E. Scale 


On the basis of these results bearing upon the relation 
between time and moves, and in view of the earlier find- 
ings, the following score-card was devised (Table LXIII). 
The attempt was made to apportion due weight to 
(a) score value, (b) time, and (c) moves in the ratio of 


about 4: 2:1. 
TABLE LXIII 
Score Carp 


Excess TIME 


Desicn |P.E. Score Excess Moves 


NomBer | VALUE | Depucr 1 Port | Depucr 2 Ports | DEDUCT x Port 
I 3 21” and over 6 and over 
II 5 31” and over 7 and over 
Tit 6 21"— 35 36” and over 8 and over 
IV 7 31"—1' 1’ 1” and over Io and over 
V 7 30" 5 1’ 6” and over Ir and over 
VI 7 36”—1" 1’ 1” and over 12,and over 
Vil 9 56”—-1'10” 1/11” and over | 15 and over 
Vill 8 Ate 55 56” and over ro and over 
IX 7 41"—1'10” 1/11” and over rz and over 
BG 9 1'56"—2'10” 2’11” and over 22 and over 
XI 9 1’36"—2' 2’ 1” and over 18 and over 
XII 8 1/46 "—2'30” 2'31” and over Ig and over 
XIII 9 1'31"—2'30” 231” and over 18 and over 
XIV 9 2'26"—2'40 2'41” and over 32 and over 
XV 9 2'26"—2'40 2’41” and over 30 and over 
XVI 9 2/21"—2'33" 2'34” and over 31 and over 
XVII 8 1'56"—2'25” 2'26” and over 30 and over 
XVIII 9 2'41"—-3' 0” 3 1” and over 32 and over 
XIx 10 2'4t"—3' 5” 3’ 6” and over 31 and over 
XX II 2/41"—2'55” 2'56” and over 30 and over 


Maximum Score = 159 Points 


The information in the last three columns of the pre- 
ceding table was obtained by plotting first the norm 
data for each design at each age, both for time and for 
moves. All the curves were then smoothed. After that 
the year-range of the curve was divided into as nearly 
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three equal year-divisions as possible. Thus for design 
XI the total year-range for the time-and-life-age curve 
was nine years (age 8 toage 17). All times, then, falling 
within the range of years between 14 and 17 were 
allowed as legitimate. One point of the score value of 
the design, however, was to be deducted if the time 
taken fell within the range of years from 11 to 14, and 
two points were to be deducted if the time taken fell 
within the earliest range of years, namely, between the 
years 8 and 11. The same procedure was utilized for 
determining the deductions for excess time on the other 
designs, except designs I and II for which the method 
pursued for moves was followed. For the one point 
deduction for excess moves the year-range was divided 
into two parts. The range of moves covering the higher 
half of years was regarded as legitimate, whereas the 
range of moves covered by the lower half of years was 
regarded in excess and one point was designated as a 
reasonable deduction from the score value of that design. 

Other methods for arriving at an objective criterion 
for making subtractions for excess time and moves were 
possible.! For example, instead of the year-range being 
divided into three equal divisions, the score-range might 
have been thus divided. Another method possible 
would have been to take the score-range and divide it 
into four equal parts. Two points would then be de- 


1TIt did not seem that any other possible methods possessed any 
superior value over the one actually utilized, and in any event, what- 
ever the procedure for penalizing excess moves and time, the chances 
are very great that no great differences would have resulted in the 
ultimate score assignments to each performance of the block-design 
tests, and in the final standards. 
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ducted for the first quarter of the range falling at the 
lowest ages, one point would then be deducted from the 
middle range of 50 per cent, and all times falling within 
the upper range of 25 per cent would have been regarded 
as legitimate. 

Utilizing the scoring instrument thus devised, all the 
tests were then re-scored. The original correlation be- 
tween the Binet Scale and the number of designs suc- 
cessfully completed (already designated as, the “raw 
score,” time and moves not being taken into account), 
was + .82, + .o1. The table is presented herewith: 


TABLE LXIV 
CoRRELATION BETWEEN BINET MENTAL AGE AND RAW BLOCK-DESIGN 
SCORES 
Binet Age 

Raw Scores 3|4|15]|6] 7] 8] 9] 10} rz! 12] 13] 14] 15] 16] x7] 18] r9| TOTAL 
° 3) 7\24)14| 3) 1 I 43 
I 7) Oooh 22) tier 32 
2 : SHO ONO 30 
3 3 4| 6} 6} 5] I} x 2| I 26 
4 : D7 Ob 5 (ai et le Dok 24 
5 - I] 3] 9} 6| 5] q] 3] 1 27 
6 : I} 5| 4! 4] 4! 3] 2 I 24 
7 : 4 6| 6! 3] 1 I Die 
8 Ne seghe Ll = I II 
9 I| I 2| 4| 1] 1] 2 12 
10 Diese I II 
II Seine 4| 4| I I 10 
12 4 Cer oor L\eTl er 8 
13 I 4), 2| 2) 1 Be) 
14 2| Al x) 5) 1 I 14 
15 Ae Leo iE Io 
16 33) 73 4| 1| I 9 
17 : Ee 3)) 5) 2) 5 |0 0) 0 pap cate 
18 ° capa Bl yrs II 
19 x 2 || 1), 2hx| 1) 21> Er 
20 I Atel Fl edl ale aay 

Total .. . | 3) 7/14/31}20|52/37|44/44/31/20|17/1z\11| 7 4) S 366 
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Although some of the values in the preceding table 
are scattered, there is a marked consistency in the in- 
crease of raw score with increase of mental age. 

Upon rescoring the 366 tests in order to assign due 
weight to success, time, and moves, the coefficient of 
correlation is not changed to any appreciable amount, 
but there is a marked decrease in the fluctuation, or 
spread, of scores over any given range of years. This is 
more apparent after the elimination of certain designs, 
discussed more in detail in the succeeding section of the 
monograph. The correlation table follows: 


TABLE LXV 


CoRRELATION BETWEEN BINET MENTAL AGE AND ScorRE Pornts 


MENTAL AGE 


HH HOH 


HWOWWHER HWE DH 


wb NWN HH HH 


III-I20 
121-130 
131-140 
141-150 
151-160 


OHHH HEN AU AUNMN 


to 


Total . . | 3) 7/14/31/20/51/37/44/44|31|20\r7|rx|12| 7 4] 5} 366 


r=-+ .83, + .o1 
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In order to appreciate the significance of this coeffcient, 
the following list of correlations between the Stanford- 
Binet test and other intelligence tests is presented: 


Block-design Test and Binet Test. . +.83 
Army Alpha and Binet Test,! .+ .80 to + .90 
Army Beta and Binet Test! . . . +.73 


Stanford-Binet and Stanford-Binet (repeated tests),! + .94 to + .97 
Stanford-Binet Entire and Stanford-Binet Abbreviated (2 tests per 
year)! + .92 
Each Army Performance Test and Stanford-Binet!: ~ 
1. Ship Test 
. Manikin and Feature Profile Test 
. Cube Imitation Test Lowest Correlation, +-.48 
. Cube Construction Test 
Form Board Test 
. Reproducing Designs Test 
. Digit-Symbol Test 
. Maze Test Highest Correlation, +.78 
9. Picture Arrangement Test 
to. Picture Completion Test 
Abbreviated Army Performance Test (5 Tests) and Stanford Binet,! 


ON ANA WS 


+ .84 
Stanford-Binet and Seguin Form Board, . . +.55 
F BOYS ie yates eed 
£ 2 
Porteus and Stanford-Binet { ide hein Rens 


Healy’s 3 Form Boards (Mare and Foal, Construction Test A, and 
Construction Test B) and Stanford-Binet Mental Age? . + .45 
Porteus Mental Age and Stanford-Binet Mental Age? . . . +.79 


Army Alpha + 5 
Teachers Estimate and Ferguson Form Boards 4 + .50 
Class Standing + .56 
Grade Location and Form Board Ability,4 + .80 


1C.S. Yoakum and R. M. Yerkes:‘‘ Army Mental Tests” (New York, Holt, 1920), p. 20 

2S. D. Porteus: ‘‘Porteus Tests — The Vineland Revision” (Vineland, 1919), p. 28> 
IQ, 20. 

3 Elizabeth L. S. Ross: ‘‘ Vocational Tests for Mental Defectives: Studies in Mental 
Inefficiency” (1921), 2: 1-6. 

4G. O. Ferguson, Jr.: ‘‘A Series of Form Boards,” J. of Exp. Psychol., 1920, 3: Pp. 57° 
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TABLE LXVI 
IntER-TEsT CORRELATIONS ! 


(Table Rearranged) 


Army . 
Thurstone 


Pressey 


Pintner’s Non-Language Group-Test and Stanford-Binet I. Q.,? + .66. 


A cursory survey of the stragglers in the upper right- 
hand corner of the table (LXV) reveals children who ob- 
tain high Binet scores, but do poorly in these tests. 
These are generally children who are retarded mentally 
or are feeble-minded. There seems to be evidence that 
children of inferior endowment do poorer work with 
these tests than children of superior endowment but of 
the same menial age. So, too, the stragglers at the lower 
left-hand corner of the table are children who are foreign 
born, the language-handicapped, such as the Portuguese, 
Italians, Japanese, and Chinese, who do poorly with the 
Binet, yet obtain good scores on the designs. 

The following are the median scores at each mental 
age. These medians were determined from a table of 

1 J. A. Clement: “* Use of Mental Tests as a Supplementary Method for Making School 
Adjustments in Colleges.” Educ. Adminéstr. and Superv., 1920, 6: p. 441. 


?R. Pintner: “‘A Non-Language Group Intelligence Scale.” J. of Applied Psychol., 
TOTO, 3: TOQ-2T4, P. 214. 
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original data, no grouping of scores beyond the one unit 
being made for scores 1 to 15. Beginning with score 16, 
however, the frequency intervals were 5 score-points. 
The median values in Table LXVII are, therefore, inter- 
polated only from age ten up. The left half of the table 
presents actual values, and the right-hand portion the 
medians obtained from the smooth curve of Graph 42. 


TABLE LXVII ‘ 


MEDIAN Scores AT EACH MENTAL AGE 


ActuaL MEDIANS SmootH CuRVE MEDIANS 
AGE Score Points AGE Score Points 
3, 4,5 ° 3, 4,5 ° 
(yee i : I 
i ome 5 7 5 
Sue I5 8 9 
9. 13 9 17 
TOW. 29 5 ge) 29 
II 48 II 41 
I2 63 12 55 
I 3 13 71 
= ee 14 88 
I5 118 I5 I04 
16 II4 16 118 
17 143 17 133 
18 138 18 143 
19 132 pe) 152 
20 TSOee 20 159 


Graph 42 is the curve showing the increase of score 
with mental age. The dots represent the median scores 
at each age. The deviations between the curve and the 
actual medians are explained largely on the basis of 
idiosyncracies in the age-groups tested. Thus at age 
thirteen, the difference is quite striking. But by referring 
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back to the table showing the correlation between Binet 
age and life age (Table XIII) it will be observed that at 
thirteen the median mental age of the group examined 
(33 —16 boys and 17 girls) was about twelve years, a 
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retardation of approximately one year. Referring back 
to the curve (Graph 42) for the performance of the 12- 
year-mental-age group, it will be observed that this 
group attains scores superior, on the average, to the 
12-year standard, but inferior to the 13-year standard. 
The explanation is practically the same for the deviations 
at the other ages. 
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There was a twofold motive in further work to make 
the block designs a reliable and a serviceable test: In 
the first place, it was deemed wise to reduce the time 
for giving the test as much as possible without a sacrifice 
of reliability; and, on the other hand, there were a few 
designs which, if eliminated, would tend to decrease the 
scatter of scores over a given range of mental ages. It 
was for these reasons that further analyses were made, 
in order to determine which designs could’be sacrificed 
in order to bring the above desirable conditions to pass. 
Space prohibits an extended discussion of the technique 
of elimination, but the main features of the revision are 
presented in the following section. 


4. FINAL REVISION 
(a) Eliminations 


In reducing the number of designs it was recognized 
that the most desirable procedure to follow would be 
that which would result in the greatest reduction of 
scores for those of progressively poorer mental capacities, 
without affecting the scores of those of higher mental 
development. A general leveling of scores, without a 
compensating increase in the diagnostic importance of a 
unit score, as a rule, decreases the actual diagnostic value 
of any measuring scheme. The designs, therefore, 
which were considered for elimination were those falling 
within the middle range, namely, designs VII, XI, XIII, 
XIV, XV, XVI, and XVII. On the basis of various 
criteria which were utilized, those designs could more 
easily be sacrificed than the others. 
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Three elimination schemes were tried: 
(a) the elimination of designs VII, XI, XIII, XVI, 
and XVII; 
(6) the elimination of designs XI, XIII, XIV, XV, 
and XVII; and 
(c) the elimination of designs XI, XIII, and XVII. 


The final eliminations to be effected were to be those 
which would (a) most effectively reduce the scatter or 
range of scores from ages 3 to 19, (6) that would save 
time with least sacrifice of diagnostic efficiency, (c) that 
would result in a higher coefficient of correlation between 
block-design score and Binet mental age, and (d) one 
that would show an increased reliability of final score 
achieved. 

Elimination Method (a). Thus elimination method 
(a) permitted a maximum score attainment of 115. The 
correlation beween the number of points lost (from the 
original score using the twenty designs) and Binet age 
was + .63.1 The number of cases in which the score 
was affected was 140 or 38 per cent. Analyzing the 
results of this re-scoring method more closely, it becomes 
apparent that taking each mental age there has been a 
greater ratio of reduction in the scores of the lower ages 
(73 per cent) and a smaller ratio of reduction in the 
scores of the upper ages (27 per cent) — although the 
absolute values show a gradual increase in points lost 
with increase of age. The changed scores make for a 

1 This coefficient may also be interpreted as the correlation between 
these five designs taken alone and Binet mental age. This is a fair 


criterion of the reliability of the block-design tests as a whole, if these 
five designs are the poorest. 
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greater differentiation between the lower and the higher 
mental ages. Although the extremes of score were 
from 5 to 159, the latter score being 31 times the 
former, the extremes of per cent lost were from 8 to 41, 
only 5 times the former instead of 31. 

Elimination Method (b). Rescoring the tests on the 
basis of the eliminations by method (6) the maximum 
score attainable is 115, the same as by method (a). Here 
again the correlation between block-design scores and 
- Binet mental age was + .85 +.01. In this instance, 
however, the scores at the lower ages were affected to 
the same extent as by method (a), but the scores at the 
higher ages were reduced in greater proportion than was 
the case with method (a), largely due to the limitation 
of designs eliminated to those above design X. Com- 
paring the two methods, it was found that in 46 per cent 
of the cases, method (a) yielded higher scores than 
method (b), in 24 per cent of the cases method (6) yielded 
higher scores than method (a), and in 30 per cent of the 
cases, the scores by both methods were exactly the same. 

Elimination Method (c). Based on the results of 
methods (a) and (0), method (c) is a compromise, only 
those designs being cast for elimination which were 
common to methods (a) and (6). By this method the 
maximum score attainable is 133, 26 less than when all 
the twenty designs are used. The correlation between 
block-design score points and Binet mental age is + .84 
s+ .or. Asurvey of the correlation table (Table LX VIII) 
reveals a somewhat greater censolidation, or a reduction 
in the scatter, of the tabulated scores about the mean 
trend as compared with the original correlation table 
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(Table LXV) which presents the scores based upon the 
use of the total twenty designs. 


TABLE LXVIII 
CORRELATION BETWEEN BINET Mentat AGE AND SCORE POINTS 
(Elimination Method (c)) 
Binet Mental Age 


Score Points 3)415 | 6/7 | 8 | 9 | ro} rz] 12} 13] 14] r5| 16] r7| 18] 19] ToTAL 
(o) See en Sit FA eAte sk I 43 
ToATOL a eae I5|19|20/12] 6} 5] 1] I] 80 
T1720) ches 2| 3/13/12] 9| 21 2] 4] z 47 
21 SO thts 3/10) 7] 9} 5) 4) 3 2 43 
BI= AO ee 6] 2)\-3) 74 I 23 
ASSO ee ners Tl. a) | 6} Gp siesi2 26 
51- 60 yo i cd Ps A fo 16 
61- 70 Tl FE) 3) 4) Sl Fh eh I5 
71- 80 PAN 1 fats 3 2 16 
81- 90 I 3] 2) 4) x II 
QI-I00 5 9 a) fo 2 Io 
IOI-II0 I| 2 I] 2] 3 3f°3].3] 8 
III-I20 z Bee's ae 3 Bes I 7 
I2I-130 I I] 3] 2 4B 
131 
andover . . 2 (ed ie 3 
Total ~~. | 3) 7/14/31/20/51/37|44/44/31|20|17|11|11| 7| 4] 5] 366 
r=-+ .84 + .01 


A comparison of the mental ratings resulting from 
this new array of designs with those in which all the 
designs were included, and with those in which elimina- 
tions (a) and (6) were made, revealed that the original 
determination of reducing the scatter of scores, of saving 
time without a sacrifice of diagnostic efficiency, of in- 
creasing {the validity of the final score achieved, and 
of increasing the correlation between block-design scores 
and Binet mental age, had, to a degree been accom- 
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plished. The superiority of elimination method (c) is 
again made manifest from the following table, which 
shows what per cent the quartile deviation is of the 
maximum score (the score-range) at each age, for each 
of the elimination methods. 


TABLE LXIX 


Per CENT THAT Q. D. Is oF ScoRE RANGE 


AGE 


6 | 7 | 8] 9 | 10} rz] 12] 13] 14] 15] 16} 17] 18] ro 


No designs eliminated . . | 2 | 2 | 6] 6]r4|]rt5|10]25|16|24117] 6] 5] 6 
Peeanatien Method). | 3 ba | Bolsalre|olgslesiastzsh o] 513 
Pieciascon Methed ©). |'s. | 3'| 8 Bltalealeoloalcglatian| Blah 
Elimination Method (c) . Pela ol rleainalereeiectasiaolbaloice 
et ee el LC letelel lal balele 
Method Preferred . . . janyjany|c|c|c oF ns ue b in clala - 


The directions for the block-design test, the methods 
of scoring, and the norms, to which Chapter II of Part B 
has been exclusively devoted, are based upon the results 
obtained after rescoring the test blanks, designs XI, 
XIII, and XVII being eliminated. The designs, after 
this final revision, have been renumbered as already 
explained in the introduction to this chapter, each de- 
sign now being designated by an Arabic instead of a 
Roman numeral. 


(b) Sex Differences 


On the basis of the changes in scoring above indicated, 
a second analysis was made to determine sex differences. 
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This attempt was not as thorough or as complete as the 
first, indications very early pointing toward no change in 
the original findings. There was no reason to expect 
any shifts in the comparative performances of the sexes, 
since all efforts with the designs were in the direction of 
refining the test procedure and of improving the method 
for placing a specific intelligence-valuation upon any 
given response. 

The block-design test as it now stands is comparatively 
free from the disturbing factor of sex for the first ten 
designs and for ages below thirteen or fourteen. For 
the last seven designs and for ages above thirteen, boys 
seem slightly superior to girls. The reason for this dif- 
ference at the upper ages and for the more difficult 
designs is not immediately apparent. Attention has 
already been directed toward reasonable explanations. 
(See pp. 118-121, and pp. 125-126.) 

Possibly introspective evidence might throw consid- 
erable light upon the matter. At any rate, the differences 
between the sexes are not so great as to invalidate the 
results which one might obtain, nor is a compensating 
formula necessary to correct any error which might be 
theoretically assumed. For all practical purposes sex 
differences may be disregarded. 


(c) Final Norms 


The final norms, with a suggested procedure for giving 
and scoring the block-design tests are presented com- 
pletely in Chapter II (Part B). The writer has assembled 
all of this material in one chapter, in order to facilitate 
the use of the designs and to assist the interpretation of 
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results derived therefrom. The longer one uses the block 
design tests, the more is one convinced of the superiority 
of the P. E. method of scoring and interpretation over 
the year-scale method. By means of the former, finer 
gradations are possible, resulting in finer intelligence 
differentiations. It is therefore recommended that the 
P. E. method be used in preference to the year-scale 
method. 


CHAPTER V 
The Results 


I. DO THE BLOCK DESIGNS MEASURE INTELLIGENCE? 


To answer this question, one must necessarily first 
define intelligence. Perhaps the easiest way out of the 
difficulty is to state that this test measures very largely 
the same kind of mental processes that are measured by 
the Binet scale. And if the Binet scale measures intelli- 
gence, so do the block designs, as is evident from the 
high correlation between the two. 

To some, this reply may appear an evasion of the issue 
and quite unsatisfactory. In that case we must review 
the current definitions of intelligence. These fall prac- 
tically into two types, (a) those expressed by Ebbinghaus, 
Ziehen, and Meumann, and (0) those expressed by Binet, 
Stern, and Terman. According to’ the first group, 
“Tntelligenz ist Kombinationsgabe”’ — intelligence is the 
ability to “put two and two together,” the ability to 
combine, to synthesize. Whenever, for purposes of 
adaptation or problem solution, we are called upon to 
bind together, or to relate, two or more experiences 
which have, in our own lives, never before been tied up, 
we are utilizing “intelligence” factors in the process. 
The more efficient this combination in actual practice, 
or the less open it is to error and misdirection, the more 


effective has been the functioning of this “intelligence 
168 
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ee There is no question but that “intelli- 
gence” is dependent upon a large mass of materials which 
have been acquired through experience and stored away 
ready to be called upon whenever occasion demands its 
use, but “intelligence” as such is neither “experience” 
nor “information”? but “combinative power” — the 
ability typified, for example, in the mechanics of syllogis- 
tic reasoning. 

_ According to the second group, intelligence is the 
capacity of an individual to adapt himself to new situa- 
tions. Whenever we are confronted with problems, 
questions, situations of one sort or another, which call 
for new modes of behavior, an adequate solution of the 
difficulty, if not accidental, is the result of the operation 
of “intelligence.” Whether “intelligence” has been 
utilized or not — and if used, to what extent— may be 
determined by appraising the result. What “‘intelli- 
gence” does is the matter of chief importance. On1y by 
a knowledge of the range of possible accomplishment and 
by our ability to measure differences in this capacity can 
we make practical application of the functioning of incel- 
ligence in such fields as education, delinquency, desec- 
tiveness, and industry. 

It is apparent upon careful analysis that neither ot 
these definitions really touches rock-bottom. Severe in 
the standards by which definitions of those we examine 
are judged, we ourselves indulge in an infantile reaction 
for which we merit some condemnation. As mature, 
thinking people our definitions should certainly be 
“better than in terms of use.” To define intelligence as 
‘adaptation to new situations” is but little superior to 
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that of an immature youngster who defined “soldier,” 
“to fight.” We wish to know what intelligence is, not 
what it does. Although the explanation of intelligence 
as ‘“‘combinative ability” falls short of a complete 
definition, it does introduce us, however, more intimately 
to the basic processes underlying “‘intelligence-activity.” 
Psychologically considered, “adaptation” is a most 
complex activity, and intelligence cannot be defined as 
adaptation, because we are not here dealing with those 
elements which condition adaptation. 

The reader’s attention, at this point, may well be 
turned to our earlier consideration of the processes of 
analysis and synthesis. We noted there that these men- 
tal activities were of the greatest importance in the 
growth and development of hierarchies of mental 
functioning. No matter where our cross-section was 
made, whether at perception, ideation, judgment, reason- 
ng — there we found these phenomena, analysis and 
synthesis, explaining to a large extent the compounding 
and the unifying of processes and of mental material. 
We noted then that our ability to analyze a presented 
situation, is as important as our ability to synthesize 
details into a unity. Ebbinghaus, Ziehen, and Meu- 
mann overemphasize the importance of ‘‘ Kombinations- 
fahigkeit,” making slight if any mention of “analytic 
ability.” To that extent they fall short of a satisfactory 
definition of intelligence. To illustrate, suppose one is 
suddenly, and for the first time, confronted with this 
problem: Devise an instrument which will assist you 
in overcoming the effects of gravity. Immediately, 
numerous ideas come to one’s mind. Perhaps you think 
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of balloons, elevators, aeroplanes, feathers, birds, your 
body weight, electronic forces, etc., etc. The goal to be 
attained continually thrusts itself into your conscious- 
ness, often working havoc with what seems a perfect 
plan. Conditions of all sorts are considered, weighed, 
and measured. Handicaps of all varieties are met with 
and either they master you, or you master them. Be- 
fore you have proceeded very far upon your program 
of action, you have been dealing with a host of details — 
you have been comparing, discriminating, ‘“‘analyzing,” 
“combining,” judging. Suppose now, some definite 
solution finally comes to you. Let us assume you have 
decided upon some intricate electrical mechanism. 
This decision would never have been reached had various 
details not been synthesized into what appeared, after 
a good deal of checking of experiments, a logical, practi- 
cal plan. 

Intelligent acts of all sorts require both an analysis 
of the situation which confronts one, a critical inquiry 
into methods of solving the problem, and a final synthe- 
sizing of details into a consistent whole. Our definition 
of intelligence as “adaptation” fails to take into ac- 
count the higher syntheses and analyses of the thinker, 
the scientist, the generalizer, the discoverer of laws. 
What factors of ‘‘adaptation” are there present in the 
propounding of a theory of heredity, of a doctrine of 
evolution, of a “periodic law,” of an electronic theory, 
of a cosmic hypothesis? Nevertheless, such syntheses 
are often the results of years of painstaking labor, 
critical search, and the keenest of insight. Few, if any, 
will deny that these are most decidedly the results of 
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the highest type of intellectual functioning. It seems 
clear that the definition of intelligence as “adaptation” 
breaks down most emphatically at just this point. 

Intelligence more adequately defined would be ex- 
pressed as the ability of-an individual to analyze and 
synthesize. Ability in this direction varies as does 
physical height. And there can be no intelligent adap- 
tion of any sort which is not conditioned upon these 
fundamental activities. Analysis and synthesis are the 
mechanics of intellectual behavior — adaptation to 
changing situations is but one of the many results. 

To return now to our original proposition, do the 
block designs measure intelligence? It may be stated 
in reply that there seems to be no reasonable doubt, 
substantiation having been obtained through introspec- 
tions, that these tests require first, the breaking up of 
each design presented into logical units, and second, a 
reasoned manipulation of the blocks to reconstruct the 
original design from these separate parts. The results 
of this activity, it is presumed, yield a fair index of this 
analytic-synthetic power which we have termed “‘in- 
telligence.” 


2. VALIDITY 


To measure the validity of any newly devised test of 
intelligence is not a simple matter. It devolves upon 
the standardizer to present evidence that the new in- 
telligence scale measures this inadequately defined 
entity “intelligence” with approximately the same 
degree of accuracy as those standards or “measuring 
rods” now commonly accepted and in current use. 
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In the following sections thé writer will limit his dis- 
cussion to ten criteria, although admittedly, these are 
neither exhaustive nor of equal importance: 


(1) The mental processes employed; 

(2) Increased in score from year to year; 

(3) Correspondence of median mental ages; 

(4) Correlations between mental ages and intelli- 
gence quotients; 

(5) Correlations with teachers’ estimates of intelli- 
gence, and with school standing; 

(6) Conformance of intelligence-quotient distribu- 
tion with normal probability; 

(7) Correlations with vocabulary; Trabue B and C 
and Military Test; 

(8) The probable error of a block-design mental age; 

(9) The segregation of the feeble-minded; 

(10) Percentage ratios of agreement and disagreement 

with established standards of intelligence. 


(1) Mental Processes Employed 

In devising and standardizing this test the writer did 
not approach the problem with any bias of “faculty 
psychology.” The idea still seems prevalent, though 
not as much now as in the immediate past, that in order 
to possess an adequate measuring instrument for intelli- 
gence, the device must contain separate tests for each 
mental “function”: sensation, perception, association, 
imagination, memory, judgment, reasoning, etc. On 
the other hand, it has been amply demonstrated that 
the only intelligence scales worth the name draw service 
freely from all “functions.” Binet has pointed out that 
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all “intelligent operations” involve the functioning of 
three primary activities: first, attention to the problem 
presented; second, a conscious attempt on the part of 
the subject to consummate an adequate adaptation to 
the situation; and third, the exercise of auto-criticism in 
order to determine how efficiently the specific “adap- 
tation” has solved the problem. Put in somewhat 
different words,! “Binet’s conception of intelligence em- 
phasizes three characteristics of the thought process: 
(1) its tendency to take and maintain a definite direction, 
(2) the capacity to make adaptations for the purpose of 
attaining a desired end, and (3) the power of auto- 
criticism.” (p. 147.) 

A cursory examination of the demands made upon the 
mental operations of the person tested with the block 
designs will clearly reveal that attention, adaptation, and 
auto-criticism are all involved in the successful accom- 
plishment of each task. That point in the graded series 
of designs at which a child will begin failing to achieve 
further success, will be a rough measure of the develop- 
ment of his ability to attend, to adapt, and to critically 
survey his general plan of performance and his ultimate 
accomplishment. In his discussion of the ‘patience test’ 
in the 1908 scale, and these words might as well apply 
to the block-design tests, Binet states: ? 


“Tt is a game, but at the same time a work of the intelli- 
gence. When one analyzes the operation it is found to 


' 1L.M. Terman: “The Stanford Revision and Extension of the Binet- 
Simon Scale for Measuring Intelligence” (Warwick & York, 1917; 179 p.). 

*“The Development of Intelligence in Children,” Publication No. 
IT (Vineland, 1916). 
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be composed of the following elemetits: (1) Conscious- 
ness of the end to be attained, that is to say, a figure to 
be produced; this end must be understood, and kept in 
mind; (2) the trying of various combinations under the 
influence of this directing idea, which often unconsciously 
determines the kind of attempt which should be made; 
(3) judging the combination formed, comparing it with 
the oii and deciding if it resembles the other.” (p. 
195. 


If “intelligence” involves the following mental opera- 
tions: analyzing, combining, comparing, deliberating, 
completing, discriminating, judging, criticising, and 
deciding, then the block-design tests may, with justice, 
be said to call upon the functioning of intelligence and 
to that extent they are a measure of that mental capacity. 


(2) Increase in Score from Year to Year 


As regards the second criterion, reference to Graph 6 
and to the various tables of Chapter IV will clearly reveal 
that this requisite is satisfied. 

By itself, this evidence would be wholly inconclusive, 
for the reason that growth in height and in weight also 
show rising increments with every year of increasing 
life age, yet these values are not diagnostic of mental 
growth. It is only in relation to other standard criteria 
that the evidence of yearly increments has any validity. 

A slight diversion from the main theme of this section 
may not be out of place. 

A matter worthy of note is the lack of consistence in 
the variability of one mental age (Binet) in terms of the 
other mental age (block-design) at various age levels 
(see Table LXX). Thus up to Binet-age 7, and after 
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Binet-age 16, the variability in comparable block-design 
age is slight, but from Binet-age 7 variability increases, 
reaching a maximum at Binet-ages 10 and 11, and 
decreasing thereafter to Binet-age 17. 


TABLE LXX 


BinET-AGE AND Bitock-DEsIGN AGE 


Binet-A ge 
ee 
Buocx-Dxsicn Acz| 3] 4] 5] 6| 7| 8) 9)10|r1)12|13|/14/15)16/17|18|19| Toran 
Below 
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ORT ydey eae Io|ro]xro] 2| 3] 3} I] 1 40 
ane 2| 7| o| 7| 2| x I 29 
Save 4| 3} 4]r0] 4| 2 Allee: 30 
9. I| 3|14] 6} 7] | 4| 2 38 
IO. 2| 6) 5] 8! 5] 2] 3 2 33 
TT 6] 2} 4] o| 4 I I 27 
i2m6 I| x} 2} 6) 8] 3] 4} 2 28 
TG aea cs Dsl Fe Si st oe I 22 
14. 2). 3) 2)-7 4 2 20 
15s 2} 3) 5} 3) 4| I 18 
m6. Tli2 Bl Desks It} css te 
Tere r 2 4t Tl" 3] 2hetl ae 
TS I 2 3 
19. t\ 2 I 4 
20 2| 2] x 5 
Total . | 3] 7\14/31/20|52/37/44/44lgzl2o|r7|zz|z2| 7| 4| 5 366 


(Note: Age to means 10-7 to 11-6, etc.) 


Rather than regarding this condition a handicap, 
invalidating the tests as a differentiating mechanism for 
diagnosing feeble-mindedness, it appears, on the con- 
trary, to possess distinct advantages. Too frequently 
do the Binet tests leave us uncertain as to definitemen- 
tal classification after obtaining a quotient of 73 or 76. 
Other evidence in the case, educational, social, biological, 
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industrial, medical, is either mieager or inconclusive. We 
wonder whether the child’s superiority in memory, for 
example, may not account for a higher quotient than he 
probably actually possesses. At other times, we are at a 
loss to account for exceptional success in one or more of 
the tests in higher ages, unless it be explained on the 
basis of previous familiarity. It is at such times that an 
additional differentiating mechanism, such as the block- 
design tests, may be of pronounced value in forming a 
more definite decision as to further social and educational 
handling. ‘ 

Suppose, for example, we have just concluded the 
examination of a child whose life age is 15 years, and who 
obtains a Binet mental age of 11. The I. Q. in this 
instance would be 74. If then the block-design tests are 
given, on the basis of Table LXX, this Binet 11-year-old 
may theoretically obtain a mental rating anywhere be- 
tween 6 years and 17 years on the block-design tests — 
a possible divergence of five years in either direction. 

The value of this apparent disagreement will be self- 
evident to psychoclinicians who are daily confronted 
with the need for rapid, yet accurate, prognostic diag- 
noses. In the above-mentioned instance, an I. Q. of 50 
on the block-design tests coupled with a Binet I. Q. of 
74 and a rather negative history of self-dependence 
might be of unquestioned assistance in outlining a 
rational plan for further care and direction of a subject 
under examination. The same value, of course, would 
attach to a block-design test-result in the case of a child 
with a Binet I. Q. of 74 and with a block-design I. Q. 
of 150. 
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In view of a later return to this same matter, the 
diagnostic importance of this divergence will not be 
stressed any further at this point. 


(3) Correspondence of Median Mental A ges 


At each life age do the median mental ages obtained 
by the block-design tests correspond with the median 
mental ages obtained by the Binet tests? This question 
is an important one, and the extent of correspondence 
or deviation should measure very largely the validity 
of the newly devised tests. 

In the following table this comparison is presented: 


TABLE LXxXI 


CORRESPONDENCE OF MrEpIAN MENTAL AGES 


we NOuOR MeEpIAN’ |MEDIAN BLOCK- DIFFERENCE AVERAGE OF 
Ves CASES Binet AcE| Dersicn AGE |BETWEEN MeEpIANS| Two MEDIANS 
. Yrs.-Mos. Yrs.-Mos. (Mos.) Yrs.-Mos. 

on . 16 6- I S35 Io 5- 8 
Vane Mekes's PG 6- 8 9 7-4 
Sukh 28 8-0 8- 2 2 8-1 

On pie 27 9- oO 8-11 I 8-114 
en Me 9- 8 Io- 3 7 9-114 
UD ites 30 10o- 6 tI- 6 12 II—'O 
Tota 29 II-I0 I2- 5 7 12- 1% 
eke OE 32 II- 5 12—- 6 13 mm-114 
TA 28 TI=20 13- 6 3 13- 7% 
Sect ua 19 13- 3 I4- 0 9 13- 7% 
One. 16 I5- 6 13-10 20 14- 8 

Average—8.5 


Four important items are worthy of note: In the first 
place, the average deviation of the median Binet ages 
from the life ages at each year is 6 months; second, the 
average deviation of the median block-design ages from 
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the life ages at each year is‘8.8 months; third, the 
average deviation between the two intelligence-test me- 
dians is 814 months, and finally, the arithmetic mean of 
the two medians for each life age results in a more accurate 
approximation of what may be the “true” mental age than 
either median taken alone. 

We have, perhaps, in our early enthusiasm over the 
diagnostic accuracy of the Binet scale overlooked the 
importance and the need for calling to our assistance 
supplementary information which should aid us in arriv- 
ing more accurately at a positive diagnosis. The further 
our studies upon the fallibility of intelligence ratios 
continue ! the more does it become apparent that, at 
least for the determination of mental deficiency, a Binet 
I. Q. alone is a hazardous symptom upon which to base 
a definite diagnosis of feeble-mindedness. Many and 
frequent have been the criticisms, sometimes mild, at 
other times venomous, that the accuracy of the Binet 
result was impaired by the intercipient factors of school- 
ing and linguistic facility. It may, consequently, not 
be a mistaken procedure to utilize both a language and 
a performance test in the determination of mental level 
—the performance test to compensate for the over- 
emphasis in the Binet scale of certain capacities not 
highly correlated with intelligence per se, the Binet scale 
to compensate for the inevitable easy-spread of ability 
characteristic of practically all performance intelligence- 
tests. 


1Florence Mateer: “The Diagnostic Fallibility of Intelligence 
Ratios,” Ped. Sem., 1918, 25: 369-392. 

E. A. Doll: “The Growth of Intelligence,” Psychol. Monographs, 
1921, Vol. 29. No. 2, 130 p. 
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After comparing the Binet age medians with the block- 
design age medians for each life age (Table LXXI), 
it may be sufficient to remark, in conclusion, that the 
approximation between the Binet and the block-design 
medians is remarkably close, especially when we con- 
sider that the block-design tests are free of |the “language 
factor” and of the influence of schooling. 


(4) Correlation between Mental Ages and Intelligence 
Quotients 


One of the greatest handicaps experienced in standard- 
ization is to select a standard of comparison} which is 
absolute. All existing standards are, unquestionably, 
affected by a variety of disturbing factors, frequently 
difficult to determine, and always difficult to discount. 
As in the year-scale standardization, the writer may 
have erred in selecting the results of Binet testing as a 
criterion of accurate mental age. That procedure, how- 
ever, was necessary because we have, as yet, no other 
equally accurate measuring stick—one which has 
attained a similar degree of general confidence. 

For the same reason, the Binet results are again 
utilized to check the validity, in the present instance, 
of the block-design ages. 

It may be of interest, first, to state the separate cor- 
relations of the two mental ages with life age. Con- 
formance with life age is, apparently, greater with the 
Binet than with the block-design tests. 


1. The correlation between Binet age and life age is 
+ .80 (P. E. + .o1) (291 public school cases). 
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2. The correlation between block-design age and life 
age is + .66 (P. E. + .02) (291 public school 
cases). 


Segregating the results for the total 366 cases, for the 
291 public school cases, and for the 75 feeble-minded the 
correlation between Binet age and block-design age 
follows: 


3. The correlation between Binet age and block- 
design age is + .82 (P. E. + .o1) (366 cases). 

4. The correlation between Binet age and block- 
design age is + .81 (P. E.+.01) 291 public 
school cases). 

5- The correlation between Binet age and_block- 
design age is + .67 (P. E.+.05) (75 feeble- 
minded cases). 


The lower correlation between Binet and block-design 
ages for the feeble-minded is sufficiently great, to,;require 
SOMOCrCOLMIMCIE. Ne Le ha oe ei ee, Or terranes Wwodtrw 

The application of the tests to the feebloiminded| (was 
purposely divided, in point of time: the-first,.group of 
feeble-minded cases (28) were examined.jat.Vineland, 
the summer of 1917; the second group .(47),.at. the 
Sonoma State Home (Eldridge, Cal.), were, tested, during 
the spring of 1918. Almost one year. later, because.,of 
accumulated experience with the block-design tests, the 
outstanding deviations in performance of some of, the 
feeble-minded could be more intelligently interpreted. 
Dr. George Ordahl, the psychologist of the” Sonoma 
State Home, remarked during the period ¢ of experimenta- 
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tion that the block-design tests seemed to measure 
functional efficiency to a far greater degree than did the 
Binet tests. Looking back to the writer’s personal 
knowledge of the cases at Vineland this remark was 
corroborated. It appears that many feeble-minded 
actually work at a higher level of complexity and ef- 
ficiency than one would expect on the basis of Binet 
mental age. For the reason that the Binet possibly 
underestimates the work-capacity of certain timid or 
retiring or inexpressive types of defectives, or for the 
reason that the block-design tests possibly place less 
emphasis upon verbal expression and more upon per- 
formance, it seems that in certain instances the feeble- 
minded obtain inconsistent scores on the two scales, 
yet their ratings by the block-design tests are a fairer 
index of their functional efficiency in various occupations 
than the Binet. 

This is a matter which can well afford further in- 
vestigation. There still remain unchartered territories 
without number awaiting exploration by those interested 
in determining individual differences among the feeble- 
minded as well as the differences between the normal 
and the feeble-minded. 

As regards the correlation between the I. Q.’s of the 
Binet and the block-design tests, the results again are 
segregated for the total 366 cases examined, for the 291 
school children, and for the 75 feeble-minded. These 
follow: 


6. The correlation between Binet I. Q. and block- 


design I. Q. is + .80 (P. E. + .o1) (366 cases). 
The table is herewith presented: 
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TABLE LXXII 
Binet I. Q. and Brocx-pesien I. Q. 
Binet I. Q. 


20 | 30| 40] 50} 60] 70 | 80] 90] 100} rr0| 120] 130] 140] ToTAL 


Ol ~|(73|—- x be ae da 23 
40 I] —3h—4__ 6] 2] 3 ir 20 
50. ri hods Sv apy), Wa ew bars 18 
_ 60. 2] 2| 4-8) ro} xr] 2 29 
Oo 7o Elite > Ol) calla aih ce ra 21 
ae DO ey ge) T2|eLOMS Ses 44 
§ 9°: X} Z|) Sf OLaQl220) 2) 2 48 
3 100 tT] 6} 20h 20} 7] I] 1 56 
qQ tio 2) 7| Io} 13) 7h 2) I 42 
ay 120 Il 5} 8} 8S) s)—-n) 3] 209 
§ 130 1) 3) 4-547] 15 
f I40. ZW Sie So Sime ERGs Eee 
150 . a mate 2 
160 . pone I 3 
170 . I I 
Total I] 17] 14| 16] 17| 26) 51] 68) 83] go] 24] 6] 3] 366 


(Note: I. Q. of 50 means 46-55, etc.) 


7. The correlation between Binet I. Q. and block- 
design I. Q. is+.58 (P. E. + .03) (291 school 
children). 

8. The correlation between Binet I. Q. and block- 
design I. Q. is+ .67 (P. E.+.05) (75 feeble- 
minded cases). 


The correlations of the two I. Q.’s, both for the total 
366 cases and for the 75 feeble-minded are equal to the 
comparable correlations of the two mental ages men- 
tioned above. In the case of the 291 school children 
there is a marked difference, however. Whereas the 
correlation between Binet age and block-design age 
is + .81, the correlation between Binet I. Q. and block- 
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design I. Q. is only + .58. It is difficult to explain this 
discrepancy, both tables having been checked for ac- 
curacy on three different occasions. The only plausible 
explanation at this time is the greater range of the mental 
age table as compared with the I. Q. table. The latter 
has fewer class-intervals, I. Q.’s having been taken in 
ranges of ten each. 

In this connection may also be presented the individual 
deviations in I. Q. between the Binet and the block- 
design tests. Noone would expect exact correspondence, 
yet a high percentage of agreement should be demanded. 
In the following tables, segregated for the 291 public 
school children and for the 75 feeble-minded, this cor- 
respondence is presented. 


TABLE LXXIII 
CoRRESPONDENCE OF I, Q.’s 
(291 P. S. Cases) 


Median I. Q. Difference 


FREQUENCY 
LQ. Toran 

oe 7 

6-10 a 
II-I5 48 
TOS2Or baer 47 
F faa Dio ea tye 2 
20301) Decne 7 Sais a! 
31-35 . 12 
208d0" Meu binay Merten 5 
41-45 8 
46-50 uals 4 
EP Sed EY a seine 2 
56-60 . rs, 
ESRI LR UOR CRUE NOLS LR Eo 
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From the above table it is evident that 50 per cent of 
the cases show no greater deviation than 14 I. Q. be- 
tween the two tests. It is also clear that there are 
almost as many lower deviations as higher: 


The total number higher — 155 cases (53%) 
The total number lower — 129 cases (44%) 
The total number the same— 7 cases (3%) 


If anything, the block-design tests err in the direction 
of leniency rather than severity of mental age estima- 
tion. 

The closeness of correspondence is again apparent 
from the following analysis: 


63 cases (22%) 
120 cases (41%) 
168 cases (58%) 


Total deviations no greater than 51.Q 
“ “ ‘“ “ “ ol Q 
Loe (AW 
a be GT lthes “ 201.Q. 215 cases (74%) 
is 85 
o1l.Q 
51.Q 


“ “c “ “ “ 
I 


242 cases (83%) 
259 cases (89%) 
271 cases (93%) 


For the feeble-minded, the data runs parallel, ! except 
that to a certain extent the figures are much more 
significant in comparison with the same group of data 
for the 291 P. S. cases, and from the point of view of the 
diagnostic efficiency of the block-design tests. So in 
Table LX XIV the correspondence of I. Q.’s for the 75 
feeble-minded cases is presented: 


11t should be stated that all block-design zero scores were given a 
mental age rating of 5 years 3 months. This inaccuracy increases the 
I. Q. deviations. But this was purposely done in order artificially to 
increase the differences between the two I. Q.’s wherever possible. The 
comparisons throughout are, therefore, quite_conservative. 
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TABLE LXXIV 
CoRRESPONDENCE OF I. Q.’s 
(75 F. M. Cases) 


+ FREQUENCY 
Hie B. D.I.Q B.D.1.Q 
HicuEr Lower ToraL 

Same 3 
5 15 13 28 
6-10 5 13 18 
II-I5 6 3 9 
16-20 2 3 5 
21-25 I 2 3 
26-30 I 3 4 
31-35 2 2 4 
36-40 I I 
Median I. Q. Difference . 6 8 7 


It is clear from this table that 50 per cent of the total 
feeble-minded examined show no greater deviation than 
7 I. Q. between the two tests. This similarity of results 
indeed merits special emphasis. It will also be noted 
that whereas, for the average school child, there is a 
strong tendency to secure a somewhat higher score on 
the block-design tests, this is reversed for the feeble- 
minded. The latter group tends to secure lower scores. 
This is evident from Table LXXIV, and also from the 
following totals: 


The total number higher — 32 cases (43%) 
The total number lower — 40 cases (53%) 
The total number the same — 3 cases (4%) 


This evidence is in harmony with the remark pre- 
viously made, that the block-design tests assist in the 
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differentiation of the feeble-minded from the border- 
zone or the normal case. 

Although the above-mentioned differences exist be- 
tween the two I. Q.’s, yet correspondence is higher for 
the feeble-minded than for the public school group: 


Total deviations no greater than 51.Q. 31 cases (41%) 
Ss = kee Sb “ 101.Q. 49 cases (65%) 


“ “ «“ “ CTE, O.-288 cases (77%) 
" ss ina “ 201.Q. 63 cases (84%) 
33 - i “ 25 1.Q. 66 cases (88%) 
ée (a9 6c (9 cc 30 iL Q. 70 cases (93%) 


In conclusion, it may be stated that the correlations be- 
tween the two test methods, considering their marked dif- 
ference in character, are high enough to guarantee frequent 
correspondence between their mental ages and I. Q.’s. 


(5) Correlations with Teachers’ Estimates and with School 
Standing 

The search for the “fountain of youth” presented few 
if any greater difficulties than the search for criteria by 
means of which to weigh the validity of measuring instru- 
ments for intelligence. It is comparatively easy to devise 
tests, to develop an efficient technique for application, to 
establish norms, and to obtain results which may possess 
some psychological, educational or social significance. 
But to find a stable criterion for establishing validity 
appears almost hopeless. 

It has been customary to rely upon teachers’ estimates 
of intelligence to check the validity of one’s intelligence- 
test schema. It is valuable to utilize this ‘“common- 
sense” check, even though high correlations between 
teachers’ judgments and test results cannot be expected, 
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and in spite of the fact that there are some very serious 
forces invalidating such judgments. It is clear that 
the same high I. Q. receives a lower estimate by the 
teacher if a child is in upper grades rather than in the 
lower grades, because of the elimination of poorer pupils 
in the upper elementary grades. Thus an I. Q. of go is 
more likely to receive an estimate of average or above 
average in the lower grades, whereas in the upper grades 
or in the high school the same I. Q. will more probably 
receive an estimate of below average or inferior. Other 
writers have already indicated other factors, having no 
bearing upon or relation to intelligence, which interfere 
with the accuracy of judgment on the part of teachers. 

School marks, also valuable criteria with which to 
check the results of a newly devised test, are also ineffi- 
cient to an extent, because they are generally crude, are 
limited to a rather narrow range, contain spurious ele- 
ments such as neatness, order, and so on, are often 
given for disciplinary reasons, or as bait for an educa- 
tional spurt, and are not based upon uniform standards. 

However, there is a corroborative value in teachers’ 
estimates and in school standing which is worth men- 
tioning. 


9. The correlation between teachers’ estimates of 
intelligence and Binet I. Q. is + .47 (P. E. + .03) 
(291 school children). 

10. The correlation between teacher’s estimates of 
intelligence and block-design I. Q. is + .23 (P. E. 
+ .04) (291 school children). The table is here- 
with presented. 
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TABLE LXXV 
TEACHERS’ ESTIMATES AND BLockK-DEsIGN I. Q. 
Teachers’ Estimates 


4 5 6 7 


30 I 

40 I 

50 ANN es wi fe 

60 2 22 Oe Sees ltat 
o 70 Ef StUo 1s 
sto, I 6 | 21 O11 28 
a) E jars (ee2O rl eroe sow 
‘g. .LOO B72] 220) eae | as 
A 110 2 I 7 | 21 8 3 
3 120 ae 2 ler set con|. 2 
130 on SP spies 

140 Sal ROvl es 2 

150 2 

160 I I I 

170 I 

baja: Loe A ieee es 4 | Ir | 52 |131 ; 68 


1 (30 signifies scores between 26 to 35, etc.) 


f= + .23, + .04 


Although the correlation between block-design age 
and Binet age is + .82, teachers’ estimates of intelligence 
correlate only one half as much with the block-design 
I. Q.’s as with the Binet I. Q.’s. The reader may recall 
that one of the original objections to the Binet scale was 
that it measured school training. Only to a limited 
extent has this been denied, the explanation having been 
made that the tests measure intelligence through the 
medium of knowledge only partly influenced by school 
training. It has been admitted, true, that practically all 
children are exposed to these educational influences, but 
the ultimate difference in achievement is explainable on 
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the basis of differences in endowment. However this 
may be, the results of the block-design test would perhaps 
tend to show that there is more to this charge than we 
have been inclined to admit. It will, no doubt, be con- 
ceded without much question that the block-design tests 
are less affected by school training than the Binet. 

Regarding the correlations between school standing 
(school marks) and block-design I. Q. the following are 
the results: 


11. Block-design I. Q. and Reading: + .18, P.E. 
+ .04 (276 cases). 

12. Block-design I. Q. and Language: + .20, P. E 
+ .04 (259 cases). 

13. Block-design I. Q. and Household Arts: + .22 
P. E. + .o9 (48 cases: 44 girls, 4 boys). 

14. Block-design I. Q. and Drawing + .25 P. E. 
+ .04 (258 cases). 

15. Block-design I. Q. and Arithmetic: + .31, P. E. 
+ .04 (251 cases). 

16. Block-design I. Q. and Manual Training: + .36, 
P. E. + .08 (58 cases: 56 boys, 2 girls). 


It will be observed that block-design results correlate 
least with reading and language, and most with manual 
training and arithmetic. When discussing sex differences 
in an earlier section of this monograph, attention was 
called to the slight superiority of boys over girls at the 
higher ages. It was mentioned then, that perhaps the 
mechanical nature of some of the higher designs gave 
boys a slight advantage. The evidence here is, to an 
extent, a corroboration of this view. This condition 
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does not point necessarily to a weakness in the test 
scheme. It will be conceded by those who analyze the 
activity that success in manual training involves the 
utilization of intelligence in planning one’s work, in 
criticising one’s progress through the various stages of 
accomplishment, and in holding the goal to be achieved 
in mind and in attaining it. It would possibly be gen- 
erally admitted that efficiency in manual training draws 
no less upon “intelligence” than do ‘reading and 
language. 

It may also be of interest to compare the average of 
the correlations between reading, language and arith- 
metic, the “mind” subjects on the one hand, and house- 
hold arts, drawing, and manual training, the “hand” 
subjects on the other. The averages of the two groups 
are + .23 for the first subjects, and + .28 for the second. 
Again we find corroboration of the contention that the 
Llock-design tests are actually tests of performance, more 
free of the language factor than many of the tests, neces- 
sarily dependent upon language, now in common use. 
The need for the application of such a test as this in 
combination with others, in order to estimate accurately 
a child’s intelligence, appears self-evident. 

When the teachers were requested to fill out the ques- 
‘tionnaire they were asked to answer this question for 
each child examined: “If this child were given a mental 
test involving chiefly the use of language, or the ability 
to understand and handle language symbols (as con- 
 trasted with a test requiring silent observation and 
performance) would you expect him (her) to pass; very 
low, low, below average, average, above average, high, 
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very high?” It was expected that the replies to this 
question would bring to light those cases where undue 
superiority or undue inferiority in language understand- 
ing and expression might affect the results of a mental 
test dependent upon language symbols for comprehension 
and success. The correlation between block-design I. Q. 
and these estimates by the teachers follows: 


17. Block-design I. Q. and teachers’ estimates of 
language vs. performance: + .24, P. E. + .o4 
(291 cases). 


Analyzing the table of data it is found that 6 per cent 
of cases possessing I. Q.’s of 106 and over were estimated 
by the teachers likely to obtain very low, low, or below 
average scores on a “language” intelligence test, and at 
the other extreme 10 per cent of cases possessing I. Q.’s 
of 95 or under were estimated by the teachers likely to 
obtain above average, high, or very high scores on a 
“language’’ intelligence test. In other words, according 
to the judgment of teachers, it would appear that a 
total of 16 per cent, or one sixth of all children in the 
average public school, are likely to be misrated if judged 
by a “language” test alone. This proportion is probably 
too high. At any rate, the data is offered for what it is 
worth. 

By way of summary, it may be remarked that not only 
do the block-design tests show a reasonable correlation 


with school standing and teachers’ estimates of intelli- 
gence, but the emphasis upon performance as opposed to 


verbal impression or expression is a desirable feature of 
the test. 
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(6) Conformance of Intelligence Quotient Distribution 
with Normal Probability 

A very necessary index in weighing the validity of 
any standardized test is to determine the extent to which 
an actually found distribution conforms to its theoretical 
distribution. 

The assumption that the distribution of intelligence 
follows normal probability is recognized as.an arbitrary 
one, but it is utilized merely as a working hypothesis. 
If not this, what else? Until further investigation gives 
us more light on this problem we must continue to grope, 
more or less, in the dark. 

In the following table are presented the I. Q.-range 
distributions for the Binet and the block-design tests. 
The respective percentage values are compared with 
what one should theoretically expect. 

Attention is again called to the “spread” of ability 
greater for the block-design tests than for the Binet, 

‘previously mentioned. It is apparent that “intelligence”’ 
measured by the Binet test manifests a lesser diveristy 
than the block-design test. Which of the two is more 
truly representative it is difficult to state dogmatically. 
Perhaps an average of the two approaches more nearly 
the truth. It may be of interest to mention a note con- 
tained in a letter to the writer from W. A. McCall in 
which he remarks “that the distribution of Reading 
Quotients,” obtained from his recently completed reading 
scale, ‘‘conforms more closely to your I. Q.’s than 
Terman’s.” 

Whatever the true situation regarding the general 
character of the distribution of intelligence, the fre- 
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quencies of the block-design I. Q.’s conform more closely 
to theoretical expectation. Thus the average deviation 
from theoretical expectation for the Binet I. Q. ranges is 
3-3 per cent per I. Q. group. The average deviation for 
the block-design tests is only 1.4 per cent per I. Q. 
group. 

In conclusion, the evidence of correspondence between 
the empirical and the theoretical distributions testifies 
to a fair degree of validity of block-design I. Q. 


(7) Correlations with Vocabulary, Trabue B and C, and 
Military Test 


Mention has already been made of the correlations 
between block-design and Binet test results. The data 
of the Stanford-Binet vocabulary, the Trabue Language 
Scales B and C, and the military test were also utilized 
to verify the accuracy with which the block-designs 
estimate intelligence. These criteria were especially 
chosen for the reason that, besides the inevitable differ- 
ences to be expected from the application of two intelli- 
gence scales, additional disturbing factors of language 
and group testing were added in order to exaggerate the 
inherent discrepancies. It was also the intention to 
obtain some information which would throw light upon 
the much mooted questions, ‘Does the Binet test 
exaggerate the importance of language in contradistinc- 
tion to performance?” and “Are there specialized capaci- 
ties of ‘doing’ which are as indicative of intelligence as 
those concerned with ‘talking’ and ‘information’?” This 
problem, however, can only be barely touched upon at 
this point. 
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In the following tables are presented, first, the correla- 
tions between Stanford-Binet mental age and Stanford- 
Binet vocabulary score, and second, between block- 
design score points and Stanford-Binet vocabulary score: 


TABLE LXXVII 


CoRRELATION BETWEEN BINET AND VOCABULARY 


Bryet MENTAL AGE 


VOCABULARY SCORE * Mi TE Gare EG ee GS Co Ge care 
6] 7) 8} 9 | rol 11] 12] 13} 14 1s! 16] 17| 18] 19 

CC a Ua ai rg fle sands a iy ||) 8 

K=O) Mivciithen, Rel Reis ere sean eae I 16 
IO-14 gitar boty Beas epee Hea jee ea) fsa 21 
TG = TO ot teh arsieee ais to|r9| 6} 1 36 
Viory Wty Poel cee ip epee I1|r6}13} 3 43 
25-29 3/11/13] 2) 2 3r 
BOSSA Nicaea is nee oitane PAW hare he) as (oe 33 
CAT ya te Demaatinse Mie I} 3/1r} 4] zr] x] 1 22 
BOA Varta yes rte oom ts I|ro} 7] 4] 23 
Feit soo 0m By Seer UR Tl} 3)06l lays 18 
SORA er ae re Coens 2| 6} 4] 7] 4] 2] 2 26 
(AAs WOR Renee Ren ete 2| 2| 2] 2 8 
OO=O4 Nels) Pete acer I I] 3) 2) 2t 2 9 
GS=00M sce ei a ies oe I a 3)\2 8 
70-74, 2) 1] 1} 1 5 
75-79 zt] 3 4 
SOSA Nhl ee ye ae 
SEAS ele ahora ae I I 
QOROA Mates a) el en ee I I 2 

RDOtAl ced nee ee eS 25|48|36/44143 30|20]17)11|tI| 7] 4] 5] 314 


r= -+.o1, P. E. + .007 
* These class-intervals, although not the best, were used in order to correspond with 
Terman’s, 

It may be worth remarking at this point that of the 
three children who achieved the highest scores on the 
vocabulary test, two were inmates of the institutions for 
the feeble-minded! On the block-design test, however, 
their mental incapacity is evident, one achieving a score 
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between 21-30, the other a score between 71 to 80. The 
Binet ages of the two fell, for the first, between 14-7 
and 15-6, and for the second, between 15-7 and 16-6. 
Referring to Table LXXVII, the correlation ratio 
+ .gr is the same as that found by Terman in his analysis 


TABLE LXXVIII 


CORRELATION BETWEEN BLOCK-DESIGN AND VOCABULARY 


BLOCK-DESIGN ScoRE Points 


41 71 | 8x | or | ror] 111 Tora 
TO | To | TO} To | TO} Ta| TO} TO} To | To 
40 | 50 | 60] 70] 80] go | Ico} 110} 120 
3 60 
I I 16 
5 21 
8 I 36 
3 3 I I 43 
8 3 2 31 
4 5 2) 3 I 33 
2 2 eas |e) ok i) 
4 2 Bo eae & bam eae ie 23 
2 5 Dx I 18 
2 3 Al Sez ell ye 26 
I I wee, 8 
I Tl, ax 2B 9 
Ply 23 8 
2 5 
2a 4 
I 
I 5s 2 


r=+.77, P. E. + .02 


of the records of 631 school children,! wherein mental 
age and vocabulary score were correlated. Based upon 
statistical analysis, not personal opinion, the vocabulary 


is 


1L, M. Terman: “The Intelligence of School Children” (1919), p. 310. 
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test stands out clearly as the best single test in the whole 
Binet series. The correlation ratio + .g1 is to a certain 
extent spurious because vocabulary score entered into 
the estimation of mental age and to that extent weights 
the Binet mental age in its favor. In view of this condi- 
tion the correlation between Binet mental age and block- 
design mental age (+ .84) is not so much lower than one 
would conclude off-hand. Then, again, reference to 
Table LXXVIII and to Terman’s Table 41! reveals 
clearly that the variability of a block-design score in 
terms of Binet mental age is not so great, when we 
observe that the vocabulary test presents approximately 
the same degree of variability, and in spite of the fact 
that the vocabulary aided in the determination of Binet 
mental age. For 482 miscellaneous adults — hoboes, 
prisoners, delinquents and business men — Terman 
found the correlation between mental age and vocabulary 
to be + .81, three points lower than the correlation be- 
tween the Binet and the block-design tests. 

It is quite surprising to note the correspondence be- 
tween efficiency in the block-design tests and in vocab- 
ulary, the former apparently concerned with hand- 
manipulations, the latter with language, supposedly 
affected by schooling and experience. In the past we 
have been inclined to look to performance tests as 
“fillers-in”’ for the assumed inadequacies of the Binet 
tests. The high correlation between the two types of 
examination leads one to the conclusion that both 
systems call upon somewhat similar mental processes — 
processes involved in the normal functioning of intelli- 

1L.M. Terman: ‘The Intelligence of School Children” (1919), p. 310. 
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gence. So that, although the two‘methods of expressing 
this mental power differ radically in character, the men- 
tal manipulations making for successful achievement are 
fundamentally the same. 

An analysis of the reactions of the feeble-minded to the 
two test systems reveals roughly three rather distinct 
groups. On the one hand there are what Binet has 
termed the “loquacious types.” These are the feeble- 
minded who have an easy facility with language, and 
who, because of their loquaciousness and ability to 
speak with apparent intelligence on many subjects, give 
to the lay mind the impression of average mental capac- 
ity, a sort of general ability and “‘intelligence.”” These 
aments secure high scores in the vocabulary test, but 
their performance in the block-design tests is strikingly 
low. Then again, there are a number of others, con- 
siderably backward in speech expression and in language 
ability — what some have designated “the silent type.” 
The character of their actual daily activity belies their 
mental rating on the Binet scale. Low in their achieve- 
ments on this intelligence test, they are nevertheless 
capable of considerable rather intelligent effort if taught 
to do something, and are placed upon their own initiative 
which will involve no greater than a few minor adapta- 
tions. These mental deficients although markedly un- 
intelligent on a test involving the understanding and the 
use of language, nevertheless are capable of a con- 
siderable amount of useful and complex effort on the 
institution grounds. Those who have actually worked 
with the feeble-minded in their institutions will readily 
recall numerous instances which are corroborative of 
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the above remarks. Finally, there are those aments 
who manifest the same degree of intelligence-develop- 
ment by both tests. This group, of the three, is ap- 
parently the largest. 

It appears that our earlier notion that language 
capacity and performance were two somewhat mutually 
exclusive abilities was to a large extent erroneous. 
Granted a certain level of intelligence-development, 
the vocabulary test or the Binet scale are, in most cases, 
no less effective measures of that level than a reliable 
performance test itself, no matter how carefully or 
efficiently devised or standardized. But, in case of doubt, 
both tests may be given to advantage, averaging the 
results of the two. . 

What has already been said regarding the relation 
between the diagnostic efficiency of a language test and 
a performance test holds true for such a language test 
as Trabue B and C. Devised originally to measure 
pedagogical achievement in language, it was found very 
early to be also diagnostic of intelligence-development. 
It is again surprising to note the relatively close cor- 
respondence in scores between this language and the 
block-design tests. See table on the next page. 

The correlation of: + .57 between these two test 
schemes is indicative of a certain amount of common 
mental activity characteristic to both, irrespective of 
outward differences in the physical form of the tests 
themselves. 

An analysis of the regression of the block design on 
Trabue score may be of interest. From the table it 
is evident that as Trabue score increases, the increase 
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in block-design score is relatively slight. “When, however, 
the middle range of Trabue scores are reached the in- 
crease in one is paralleled by similar increases in the 


TABLE LXXIX 


. 
CORRELATION BETWEEN TRABUE B AND C AND BLOCK-DESIGN SCORES 


PBvywWbHHNHHDND 


one pb 
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2 
I 
2 
5 
4 
3 
4 
3 


r= -+.57, P. E. + .03 


other, except that the higher the Trabue score the 
greater the variability in terms of block-design score. 
So vice versa, the lower the block-design score the greater 
the variability in terms of Trabue score. This condition 
may be interpreted as indicating that at the lower ages 
facility in language is rather low, so that block-design 
scores are higher at any given age. On the other hand, 
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the reverse is true for the higher ages: Trabue scores 
here seem to possess higher diagnostic efficiency. 

A number of the children who were included among 
those tested for block-design ability had been given the 
military test when it was in its early stages of standard- 
ization. This again is a test in which the “language 
factor’? plays no insignificant part, yet is a recognized 
instrument for intelligence estimation. The cases which 
could be included in this analysis were limited, but the 
results may be of interest. The table follows: 


TABLE LXXX 


CORRELATION BETWEEN MILITARY AND BLOCK-DESIGN SCORES 


BLOCK-DESIGN SCORES 


§ 

On 

ve) 
[SS i A 


3409-359 
360-379 


Total 2} 18} 20} 27] r1| 16) ro] Io} 12 


r=-+.71, P. E. + .02 
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The correlation + .71, betweeti the military test and 
the block-design test, although surprisingly high to those 
accustomed to regard “‘performance” and “linguistic 
ability”’ as separate and distinct capacities, is neverthe- 
less to be expected in light of the fact that both test 
schemes aim to measure intelligence. 

In the following tabular arrangement the correlations 
of the block-design test with the three tests in which 
“language” plays an important réle are given: 

1. Block-design test and Binet Vocabulary . +.77, P. E. +.02 
2. Block-design test and Trabue Band C . +.57, P.E. + .03 
3. Block-design test and Military . . . +.71,P.E.+.02 

In order to determine whether the correlations between 
the block-design test and the three tests designated as 
involving the use of language might have been higher 
but for the interference of this “language” factor, the 
scores of the Binet vocabulary and the military test were 
correlated, both having the “language factor” in com- 
mon. It is presumed that if these latter two tests show 
no greater correlation than either test with the block- 
designs, that other factors than language facility enter 
to lower the correlation from + 1.00. 

The correlation between Binet vocabulary and mili- 
tary test is + .87, P. E. + .o2 (167 cases). 

It is, consequently, apparent that other disturbing 
factors than “language” are operative tending to reduce 
the correlations between these three tests. The cor- 
relations between the block-design and any one of the 
three other tests is not very appreciably lower than the 
correlations between any two random “language” in- 
telligence tests. 
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This brings us to our original problem, “Does the Binet 
test exaggerate the importance of language in contra- 
distinction to performance?” If such a condition does 
exist, its importance has been greatly overemphasized 
in the past. And to our other question, “Are there 
specialized capacities of ‘doing’ which are as indicative 
of intelligence as those concerned with ‘talking’ and 
‘information’?” a rational reply based upon our statisti- 
cal data would include the remark that there are no 
such compartment-like functions, and that facility in 
one direction is highly correlated with facility in the 
other. 

From the point of view of the validity of the proposed 
test-scheme, the block-design tests, the above-mentioned 
correlations between this performance test and typical 
language-intelligence tests bear out the contention that 
the block designs measure intelligence rather effectively. 


(8) The Probable Error of a Block-design Mental Age 


The consistency with which a newly-devised measur- 
ing instrument estimates presented values may be re- 
garded a fair index of its validity. Extreme variability 
and haphazard deviations from normal expectation may 
be interpreted as indicating lack of efficiency in evalu- 
ating quantitative differences. On the other hand, re- 
peated identity of determined values for any given 
objective quantity argues for proficiency of the measur- 
ing tool. It is, therefore, regarded important to de- 
termine to what extent, and with what probability, 
extreme deviations of significant magnitude may be 
expected, 
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The probable error (P. E:) is the statistical device 
whereby such consistency may be computed. 

In his study of vocabulary, Terman found! the prob- 
able error of a mental age based upon vocabulary score 
alone to be 9.6 months (631 children). In other words, 
based on vocabulary alone, mental age thus determined 
will not deviate from the mental age derived from 
applying the entire Stanford-Binet scale more than 94 
months in 50 per cent of cases. The table of ratios 
follows: 


Deviation Per Cent of Cases 
Le Saar dhieed SG ts PRR Seer 50 
ROR Ieee CoE a Ss ee we oe ees 40 
Repo sete Raft Seek Pea ee 20 
me eee es oats ie. Ueno AS: oh Ke) 
AMEN a tee ys rie ik eens Ae cee I 
tre—i=(1- OF 


A difference in mental age as great as three years may be 
expected in only one case out of 100, and a difference of 
two years in only 1 out of 10. Or, put differently, taking 
any obtained score, the chances that it is within one year 
correct (one year above or one year below) are 60 that 
it is, to 40 that it is not. The chances that the score is 
within two years of the correct mental age are go to Io, 
and within three years, 99 to 1. 

For adults the vocabulary test did not function as 
efficiently. The probable error of a mental age based 


1Terman, Lewis M., Kohs, S. C., and others: “The Vocabulary 
Test as a Measure of Intelligence,” Journal of Educ. Psychol., October, 
1918 
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upon the vocabulary score with this group of cases 
was 12 mos. The table of ratios follows: 


Deviation Per Cent of Cases 
TA NOSs ois faites at gsi pe a epee 50 
j Rol 12.5 gama eR aire in, oH mb 2k 31 
BA TAOS, sarc sae aca tate ce ea eis ei ei 18 
BO FAOSe<ahs is'ops wooo uetete ba Rocts Gee Renee 4.3 
r= + .81 


A divergence greater than one year between mental 
age as determined by the vocabulary alone and that of 
the Binet scale applied as a wholé was to be expected 
in 50 cases out of 100. A two years’ divergence or more 
had only 18 chances out of 100 in its favor, and the chance 
that a mental age was within three years correct was 
95-7 to 4.3. 

In the light of this information it may be of interest 
to present the probable error of a mental age derived 
from the application of the block-design tests. 

The data of the table on the opposite page were secured 
from the figures of Table LXX (p. 176). 

Although the median quartile deviation is approxi- 
mately two months lower than the average (arith. mean) 
quartile deviation, the latter, although less favorable 
to the block-design tests, will be utilized in this 
analysis. 

The data of Table LXXXT indicate that the probable 
error of a block-design mental age in terms of Stanford- 
Binet mental age is about 16 months. In other words, 
the chances are that a mental age based upon block- 
design performance will not be incorrect more than 16 
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months in at least 50 per cent of the cases examined. 
The table of ratios follows: 


Deviation Per Cent of Cases 
ED VINOS? eotaie: ois epeievetesciattesovecebel ss emit areuenene 61 
TOMO es swheiie be 4cciele 6 as oe eee 5° 
EO INOS ye eet Be See ee ae che nent eee eae 45 
SEWAGE... ook pede Ooo ks oe eee 33 
86 THOS, PA.nia ws os) s how's he 20 
20 BOSE sos oe ae icles eee 13 
GD WHOS sy arace wieucle poe an ciel eves ine een mete 8 
AS -MOS Ss os este ee te eee eee 4 
r=+ .84 


A difference in mental age as great as four years may 
be expected in only 4 cases out of 100, a difference of 
three or more years in only 13 cases out of too, and a 
difference of two years or less may be expected in 69 cases 
out of roo. 

Based upon this criterion alone the block-design test 
appears to have about 56 per cent the diagnostic nower 
possessed by the Binet vocabulary. 


(9) The Segregation of the Feeble-minded 


Although at the present time the writer has no evidence 
to adduce other than his experience coupled with a 
certain insight into the general condition of feeble- 
mindedness, it seems reasonable to assume that feeble- 
mindedness is not an arbitrary psychological and 

1These results have been derived through the use of Sheppard’s 
table of values of the normal probability integral modified for interpo- 
lated terms and presented in Table XC in Appendix III. Because of 
the interpolations this table may be found to possess greater utility than 


Thorndike’s “Mental and Social Measurements” (2d ed., p. 200) or 
Buckingham’s “Spelling Ability,” p. 35 and p. 116. 
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statistical designation which. fluctuates and changes as 
do our moral standards. After years of effort in this 
field one cannot help but be led to the conclusion that 
mental feebleness is merely one of the surface indications 
of general physiological incompetence. This notion is 
expressed as follows by Cabot: 


“Our best social diagnoses, such as idiocy or feeble- 
mindedness, do not refer to the mind only. They refer 
to the body just as much. Feeble-mindedness is a state- 
ment about the child’s body, his brain, his voracious 
appetite, the diseases to which he is likely to succumb, 
his extraordinary susceptibility to cold, and his poor 
chances of growing up. One says a great deal about 
the physical side of a child, as soon as one pronounces 
the word ‘feeble-minded.’” ! 


It is just this aspect of the general problem which has 
been overlooked by those whose only basis for the term 
“feeble-mindedness” has been the “normal curve of 
distribution.”’” Mental deficiency is a general, disordered, 
physiological condition, which transcends such simplicity 
of definition or understanding. 

It has frequently been argued that because the results 
of an intelligence test yield, what appears to the eye, 
a normal distribution curve, this in itself is complete 
proof that human intelligence is a perfectly-graded, 
homogeneous entity. The writer, at this time, merely 
wishes to call to the reader’s attention the important 
discussion by Boring ? in which he points to the fact that 


1 Richard C. Cabot: “Social Work,”’ (Boston: Houghton, Mifflin Co., 
1919; 188 p.), pp. 107-108. 

2 “The Logic of the Normal Law of Error in Mental Measurement,” 
Amer. J. of Psychol., 1920; 31:1-33. See especially pp. 12, 13, and 15. 
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whereas Merriman’s frequently quoted table of shots 
aimed at a target is generally utilized to illustrate the 
functioning of the normal law to errors, nevertheless 
“Pearson showed that the distribution of shots at a 
target, given by Merriman, is best represented by the 
sum of normal curves.” For the same reason there is 
room for belief that possibly the curve for human in- 
telligence, which in reality is not ‘‘normal” but skewed, 
may be the composite of two (perhaps more) separate 
curves, perhaps ‘‘normal,”’ perhaps not, each represent- 
ing measurements of somewhat distinctively separate 
groups. 

Any test devised to measure intelligence has a specific 
bearing upon the general problem of the clinical differ- 
entiation of the feeble-minded. The present test has 
been purposely devised to be of especial assistance in 
this general direction. After wrestling with various 
problems of clinical psychology for a number of years, 
one of the pressing outstanding questions appeared to be 
that of the borderzone case. A number of mental ex- 
aminers apparently are content with designating a child 
“borderzone intelligence,” and allowing the matter to 
rest there. This is especially true of those who have 
been given to a rather arbitrary ultilization of the Binet 
scale, chopping off cases into groups on the basis of I. Q. 
alone. So, in spite of the fact that any determined 
I. Q. may be in error 2 or more points in 50 per cent of the 
cases, if Johnny Smith is 79 I. Q. he is a “‘borderzone 
case,” but if it happens to be 81, he is just dull normal! 
Clinical psychology, to gain substantial recognition, 
must take itself more seriously! Binet I. Q. is merely 
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one of the minutiz of an adequate’ diagnostic syllabus. 
And a final summation of information from the psycho- 
logical, educational, social, medical, vocational, and 
biological fields is considerably more than can be epito- 
mized in a brief label of one or two words. 

The writer is making a plea, not for the abandonment 
of intelligence classifications as such, but rather that the 
psycho-clinician dictate his classification, and not allow 
the classification to master and dictate to. him. There 
are frequent occasions when established classifications 
fail to fit a specific case. That is the time when the 
efficient examiner manifests his mettle and his intelligence 
by freeing himself from any previous systematized 
procedure and analysis, and arrives at the truth by other 
channels and other criteria. 

Looking at the matter from a social and practical 
point of view, those who engage the services of trained 
clinical psychologists do not look for any half-baked 
theories or any speculative conclusions about certain 
individuals or families who are distinct social problems, 
They require definite, practicable, intelligent recommen- 
dations, based upon a thorough and scientific analysis 
of the factors involved. Shall this child be sent to an 
institution for the feeble-minded? Can Mary, aged 
nineteen, be held responsible for her acts? What shall 
we do with Johnny, the recidivist, father insane, mother 
out working? Shall the Jones family, consisting of step- 
father, mother, and eight children, be broken up? Ought 
we to sterilize William? Shall we place Mrs. Smith as 
a domestic? Shall Tom be sent to the insane asylum or 
the penitentiary? What can we do for the Thompson 
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family, a typical instance of continued dependency 
running over a considerable period of years? And so on, 
ad infinitum. All along the line the life, happ:ness, and 
futures of our fellow human beings are being placed in 
the balance, and we aid in tipping the balance, up or 
down. Terms such as “‘borderzone intelligence”’ based 
upon the Binet test mean little if anything in writing out 
a prescription for action necessary to be taken in each 
of the above-mentioned instances. The social worker 
who is to handle a case wishes to know whether there is 
reason to hope for a moderate degree of success at social 
rehabilitation, or whether hope of success is unthinkable 
in the light of existing handicaps and social forces. To 
him a person is normal or not, well or not, dead or alive. 
One who is feeble-minded should not be handled as nor- 
mal, he who is normal should not be handled as feeble- 
minded. For the feeble-minded the road-directions point 
one way, for those who are normal they point in the 
opposite. There exists no borderzone. 

Whatever theories we may hold regarding the develop- 
ment, the distribution, the varieties and classifications 
of intelligence, a person presented for examination is 
or is not feeble-minded. Our determination of this fact 
may take on various degrees of expertness. In standard- 
izing the block-design tests the writer was motivated by 
a desire to devise an additional tool which might assist 
in an intelligent determination of whether a person was 
or was not feeble-minded.! Among ourselves we may 

1 As used here, the term “feeble-minded” is understood to be based 


upon a thorough analysis of all phases of a person’s past and present 


history taken from all diagnostic angles, and not upon the Binet test 
alone. 
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create all sorts of fantastic notions and classifications 
about which we may pleasantly wrangle, such for 
example as the “borderzone group,” some of us believing 
that that group represents the overlap between normals 
and feeble-minded, and others of us maintaining that that 
group is a distinct, clear-cut entity, — but to the prac- 
tical worker engaged in curing the ills of humanity 
these “fantastic notions” mean next to nothing. 

What has been said may appear a rather unique and 
veiled return to an earlier contention regarding the 
“borderline case’”’! which some may have expected the 
writer to have abandoned after some hoped-for increase 
in maturity and knowledge! The chief purpose, however, 
in the present instance was to emphasize the importance 
of “differentiability” which a good test of intelligence 
should possess. For a very adequate discussion of the 
borderzone question the reader is referred to Miner’s 
monograph “Deficiency and Delinquency.” ? 

Five cases have been selected from the writer’s most 
recent clinical experience to illustrate the assistance 
which the block-design tests may render. This material 
was written on August 3, 1921, and the five cases listed 
below represent the last five consecutive examinations 
in which the block designs were used. 


1 Kohs, S. C.: The Practicability of the Binet Scale and the Question 
of the Borderline Case. Bull. No. 3, 1915, Research Dept. Chic. House 
of Correction, p. 23. 

2 Miner, J. B.: “Deficiency and Delinquency” (Baltimore, Warwick 
& York, 1918; 335 p.). 
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KEY TO ILLUSTRATIVE CASES 


Name Tests Used Date Examined 
t. Irving To... (a) Illinois Examination II, 
Form 1 July 28, 1921 


(6) Stanford-Binet 
(c) Kohs Block-designs 


2. aodnia Us ges (a) Stanford-Binet July 27, 1921 
(6) Kohs Ethical Discrimi- 
nation ! 
(c) Kohs Block-designs 
Snes Vs (a) Stanford-Binet July 21, 1921 


(b) Kohs Block-designs 


4. Frank W.... (a) Stanford-B in e t (by 
Miss K. Donald) July 14, 1921 
(b) Kohs Block-designs 


5. Kenneth X.. (a) Stanford-Binet July 13, 1921 
(0) Kohs Block-designs 


Case No. r. At the time of the examination Irving 
was 17 years 1o months old. Born in Minnesota, of 
American-born parents, German-English descent, reached 
the seventh grade, now plumber’s helper earning $5 a 
day, has a small bank savings. Father died little over 
two years ago, was a lumber piler. Three other children, 
older, one boy, two girls. Mother has no influence over 
Irving. Lives in rented two-story house. Home fairly 
furnished, clean, and orderly. Irving well clothed. 
History of delinquency may be tabulated as follows: 

1Kohs, S. C.: “An Ethical Discrimination Test.” J. of Delin- 
quency, 1922, Vol. 7, pp. 1-15. Copies of this test with complete in- 


structions and scoring material may be secured from the C. H. 
Stoelting Co., 3037 Carroll Ave., Chicago, Illinois. 
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On the Illinois Examination II, which the writer has 
adapted for individual testing, Irving obtained a total 
score for the general intelligence tests (7) of 67 points. 
This is equivalent to a mental age of 11 years o months. _ 
His I. Q. comes to 69 per cent. On the Stanford-Binet, 
with a basal year of 9, he obtains an intelligence rating 
of 12 years 4 months, giving him an I. Q. of 77 per cent. 
On the block-design test, seven out of thirteen designs 
attempted are successfully completed, yielding a score 
of 35 points which is equivalent to a mental age of 10 
years 11 months. His I. Q. here is 68 per cent, within 
one point of the Illinois Examination. 

Irving, on the basis of the Binet test, is a borderzone 
case. On the two other tests he falls below the 70 per 
cent dividing line. Taking a composite, or an average 
of the three estimates, his I. Q. becomes 71, still border- 
. zone, which was the intelligence classification finally set 
down. The complete social analysis of the case is in the 
process of being made, but the psychological report, at 
the present stage reads that “if continued social in- 
capacity is manifested in the future, this boy may be 
classified as feeble-minded and as such committed to the 
State Institution for the Feeble-minded.” 

Case No.2. Ednaisanice-appearing girl, 15 years and 
1r months old at the time of examination, and rather 
over-developed physically for her age. Born in Oregon 
of American-born parents, Irish-English descent. 
Reached the seventh grade. Mother died of tuberculosis 
soon after Edna was born. Father thought dead, but 
only recently traced to a small town in Oregon where he 
is employed as a mill-worker (general labor). Edna has 
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a brother about four years older, about whom little is 
known. She first became notorious about a year ago 
when charges of contributing to the delinquency of a 
minor were brought against the principal of a small town 
school which she was attending. The principal was 
almost lynched at the hands of the inhabitants, although 
acquitted of the charges by a jury. After this episode 
she was brought to Portland and placed with an aunt 
who is rather irresponsible. Excerpts of the report from 
the Woman’s Protective Division read as follows: 


“Sat. July 16, Edna was sent to a grocery store at —— 
Sts., to make some purchases. D—— waited on her. 
She loitered in the store looking at a book and finally 
D told her she owed him 10 cents and asked her to © 
come into the back room. She went in and D—— had 
relations with her. She says she went to the store 
between 1 and 2 and left between 2 and 3. 

“She dared not go home so started to walk. On —— 
st. she was overtaken by Ed —— who was driving an 
automobile. (Ed is a juvenile who has previously 
been before the Court for immorality.) He asked her 
where she was going and she replied to Q—— (a small 
town approximately 20 miles distant). He offered to 
take her there; she got into the machine with him, he 
drove her to Q out —— Road and had relations with 
her in the woods. Then took her back to Q at about 
10 P.M. 

“She stayed alone at Hotel, room 6, registered as 
(fictitious name) and paid 75 cents for her 
room. She says she had a little money when she left 
home. 

“Ed gave her his name and address when he left 
her. In the morning she started to walk back to Port- 
land, had no supper or breakfast. She walked all the 
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way back to Portland to ——, arriving there about 3 or 
4 Sunday P.M. 

“ George saw her standing on the street corner 
across from —— St. He and Ed took her in a Ford 
for a ride, went out past Road, both boys had rela- 
tions with her, first Ed, then George. George had rela- 
tions with her twice at this time. She thinks she was 
out with the boys about two hours .. .” And so the 
story unravels, involving more boys the farther it goes. 
The girl was not actively in search of these experiences 
but seemed a rather obvious mark to the unscrupulous. 
When this information reached the press it appeared 
under the following headlines: 

“GIRL, 15, FOUND IN SHACK, 20 men suspects 
arrested, but only 5 are held — police are of opinion 
runaway child is weak-minded — physician takes 
charge.” 


After a short period of observation Mrs. Lola G. Bald- 
win, head of the Woman’s Protective Division, declared 
the girl utterly irresponsible. 

By the Stanford-Binet test, with a basal year of 8 
years, Edna manifested an intelligence equal to 11 years 
5 months. With a life age of 15 years 11 months her 
I. Q. is 72 per cent —borderzone. Given the block 
designs she succeeded in passing only one, the first, of 
the six designs attempted. Her score on this test 
amounted to 1 point, this being equivalent to a mental 
age of 5 years 7 months. This indeed, is far from the 
girl’s actual intelligence level, but it possesses diagnostic 
significance, especially in relation to our “borderzone” 
problem. On the Ethical Discrimination Test the 
percentage efficiency in each exercise was as follows: 
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¥. Social Relations: <icc ose eenks 6 90% 
ae Grab PdeMents «6/5556 sas 0% 
ARE AMOR RRR Scars <5 siacacs 8 60% 
4. Definitions of Moral Terms..... 53% 
5. Conduct Evaluation........... 50% 
Ga Moral Proplems. © S46 coca 90% 

MCRAE ry. aistraian oy sain niece 71% 


On the basis of tentative norms this average of 71 
per cent is equivalent to the performance of about a 12144 
year-old. : 

In the light of this history, her motives, and her general 
record, the girl was declared feeble-minded, unable 
because of marked retardation in intelligence to manage 
herself and her affairs with the ordinary prudence com- 
mon to other girls of her life age. The further disposition 
of the case is now pending. 

Case No. 3. Charles is the duller-looking one of the 
two boys left with a maternal aunt after the father died 
five years ago, having been killed by a railroad train, 
and the mother had been committed to State Institution 
for the Feeble-minded two and a half years ago. Mrs. 
M brought Charles to court one day (Dec. 2, 1920), 
claiming the boy was feeble-minded just like his mother, 
that she was willing to keep the other boy, but that 
Charles was a hopeless case and consequently the state 
should undertake the care of the child. At the time of 
the first examination Charles was 7 years 11 months 
and tested, by the Stanford-Binet, showed an intelligence 
of 6 years 6 months, his I. Q. being 82 per cent, and 
classifiable as dull-normal. Although a petition in feeble- 
mindedness had been duly filed in this case, this was 
canceled and the boy turned over to the Boys’ and Girls’ 
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Aid Society for observation, education and treatment. 
Charles was born in Portland of German-American 
parentage, the father only being foreign-born. The 
child’s report card for three months showed “good”’ 
marks in all subjects except “application” for the second 
month. Charles is affected with ptosis, giving one a poor 
impression of his intelligence. On April 12, 1921, we 
unearthed the fact that a quack “‘psycho-analyst,” had 
“examined” the boy back in 1918, had adjudged him 
feeble-minded, a vacancy for the boy had been made at 
the feeble-minded institution, and in 1919 when the boy 
was about to be sent, his aunt experienced a change of 
heart. She claims Charles is unreliable, can remember 
nothing, frequently fails to come home from school or 
after being sent upon errands, and that he has been two 
years in the first grade. There is a sister of Charles’ 
eleven years old staying with grandparents in eastern 
Oregon who are very poor. When Mrs. M’s home was 
visited it was found to be a four-room affair, rather neat. 
Mr. M was found in bed where he has been confined for 
many years with articular rheumatism. The sources 
of income of the M family are distributed as follows: 
“$20 a month from Mr. M’s lodge, sick-benefit; $30 
from the county for the care of Charles and his brother, 
and the money paid by three men boarders. Of this 
money $100 must be paid every three months in pay- 
ment for the purchase of this home. Mrs. M has three 
daughters, aged 18, 16 and 8. The two eldest are in high 
school and must sleep at a neighbor’s for lack of room. 
The boarders occupy a tent in the yard. After Charles 
was at the Boys’ and Girls’ Aid Society for four months, 
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he was reported by the Superintendent as being feeble- 
minded and unplaceable. Another mental examination 
was, therefore, arranged. On July 21, 1921, Charles 
was again examined. He was now 8 years 6 months and 
on the Stanford-Binet obtained a mental age of 7 years 
omonths. Again his I. Q. was 82, and was again classi- 
fiable as dull normal. It was then decided to give him 
the block-design tests. Although on the basis of life age 
he should have secured a score of 14 points; and on the 
basis of mental age his block-design score should have 
been at least 6 points, he failed to perform any of the 
designs correctly, in spite of continued explanations and 
demonstrations. His intelligence age here was below 
5 years 3 months, yielding an I. Q. under 62. However, 
he was sent back to the Aid Society for further observa- 
tion and treatment. In the meantime his intelligence 
has been set down as dull normal, but possibly poten- 
tially feeble-minded. 

Case 4. Frank W. first came to the attention of the 
court when a neighbor reported on December 14, 1918, 
that Frank, 11, and his sister of 4 had been left with a 
maternal grandmother, a widow, the mother having 
died recently, and the father having deserted, his where- 
abouts not being known. The family also was reported 
to the local Associated Charities as being in destitute 
circumstances. It was learned later that Frank’s father 
was rather nomadic in tendency, and in 1914 had 
deserted the family for good after the second child had 
been born. On September 2, 1919, it was reported to 
us that the grandmother was abusing and unmercifully 
beating Frank. On September 8, the grandmother was 
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visited. She claimed Frank was unruly and disobedient, 
that she does punish him, there being no other way of 
getting along with him; denied most emphatically that 
she had ever punished him to an extent that might be 
deemed cruel or excessive. She was found living in a 
rented home, her income being derived from little sew- 
ings and from keeping a boarder. For some intangible 
reasons she has been ostracised by her neighbors. Al- 
though Frank did not appear quite normal to the visitor, 
his sister seemed a happy, healthy child, neat, apparently 
well cared for, and devoted to her grandmother. At 
the time of this visit Frank was attending the regular 
schools, was in the 4th grade, and the teachers gave a 
good report of his conduct in school. Four months later 
we find Frank in the Etna School (ungraded) with a 
petition for feeble-mindedness filed by the Public Wel- 
fare Bureau. He was examined July 14, 1921. His life 
age was 13 years 4 months, and on the Stanford-Binet he 
secured a mental age ranking of 8 years 9 months. His 
I. Q. was 66. On the block-design test, of six designs 
attempted two were successfully completed, scoring 
3 points on the first design and 4 points on the third 
making a total of 7 points. He was utterly lost beyond 
the third design. His mental age ranking here was 
7 years 3 months, with an I. Q. of 55 per cent. The 
grandmother admitted that the boy was feeble-minded 
but was prone to argue about the causation. Disposition 
of the case is now pending. 

Case 5. Kenneth X. first came to our attention June 
20, 1921, when Miss Ida M. Manley, principal of the 
Etna School (ungraded) filed a petition in feeble-minded- 
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ness. This was accompanied by a themorandum which 
contained the following information. Mother until 
recently a janitress in one of the schools, father died 
two years ago, said to have had locomotor ataxia. Ken- 
neth has been in special class for three years (third 
grade). Has habit of taking everything loose about 
the school. Is exceedingly clever in making up stories 
to cover his guilt. Repeated scoldings, warnings, and 
punishments have no effect. Kenneth’s mother has had 
three other children, one died because of premature 
birth, one was born paralyzed, and the other died at six 
years of age of a “natural disease,” as the mother put it. 
With a basal year of six Kenneth obtained a mental age 
of 8 years 10 months. His life age at the time of ex- 
amination was 11 years 6 months, giving him an I. Q. 
of 77 per cent, classifiable as borderzone. On the block- 
design tests, of ten designs attempted only three were 
successfully completed, and after design six he appeared 
hopelessly baffled. His total score was 11, 1 point on 
design 1, 5 on design 4, and 50n6. This performance 
is equivalent to an intelligence age of 8 years o months, 
yielding an I. Q. of 70 per cent. Other elements in the 
situation made it appear more reasonable to hold up 
proceedings on the commitment for another year, pend- 
ing further observation and treatment. 

The cases cited have not been specially selected, but 
have been taken in consecutive order. The limitations 
of space have made it necessary to omit much social 
and psychological information which is pertinent. The 
chief object has been to indicate wherein the block- 
design tests have been of assistance; consequently their 
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importance may appear exaggerated from the bare 
perusal of the material presented. It is expected that the 
reader will understand the correct proportion of emphasis 
placed upon block-design performance. 

In conclusion, the block-design tests, even though it 
should be granted that they fail to measure intelligence 
as efficiently as other standard methods, nevertheless 
are found valid because they assist in the differentiation 
of the borderzone group, some of whom are normal and 
some feeble-minded. 


(10) Percentage Ratios of Agreement and Disagreement 
with Established Standards of Intelligence 

In this section an analysis will be attempted to in- 
dicate in quantitative terms the actual amount of diverg- 
ence between the mental age and I. Q. estimates of the 
block-design test and the Binet. 

(a) The Method of Direct Comparison: Taking Table 
LXX< (p. 176) and analyzing it for agreement and diver- 
gence of mental ages, the table on p. 225 is obtained. 

It is apparent that the block-design test is inclined to 
give somewhat higher mental ages, in general, than the 
Binet. Interpreted in a slightly different fashion, the 
following tabular analysis is obtained. 


Exact correspondence and within 1 yr. = 53.8% 
‘ cae oe ee 

ce “ it cc 3 yon iz 89. 17% 

“cc “ “ “ 4 ee a 93 5 770 

5 yrs. = 98.4% 


In other words, in practically 90 per cent of the cases 
examined the two mental ages were the same or showed 
no difference greater than 3 years in either direction. 
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This substantially corroborates the findings discussed 
under the heading, “The Probable Error of a Block- 
design Mental Age.” 

In order to appreciate the true significance of this 
divergence the discrepancies between two Binet tests 
of the same individual will be stated. 

The following has been obtained from Terman’s table? 
showing the agreement between the earlier and later 
tests of 428 children by the Stanford-Binet. (Correla- 
tion, r= + .93.) 

TABLE LXXXIII 


I. Q. DIVERGENCES 


Sreconp I. Q. Ponts Sreconp I. Q. Pornts 
See HicHER (%) LoweEr (%) 
CoRRE- maa aman Dolmen ware! aes Graal Bincbds| Ween Gare eo eater | an a (fais slr e 
SPONDENCE | 5 IO | 15 | 20] 25/30] 35 | 5 |Io | 15 }20 /25 |30 |35 |40 |45 
30.0 .  ./25.0|11.8]3.0]1.9} .7 -2/14.2/8.6/2.6} .9} .2 Be 
Total — 42.6% Total — 26.7% Total 


99-3% 


Although the basis of comparison is not entirely 
equivalent, some idea may be obtained of the reliability 
of the block-design tests if compared with the discrep- 
ancies found upon measuring the same individual with 
the same measuring scale on two different occasions, the 
I. Q. in this instance being assumed to remain fairly 
constant. (Although the following observation is some- 
what aside, it may be of interest to call attention to the 
fact that the positive discrepancies of I. Q.’s obtained 
from the second Binet were more than one and one-half 


1L. M. Terman: “The Intelligence of School Children,” p. 143 
(Table 26). 
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times as frequent as the lower ones.!., It will be observed 
that exact correspondence occurs in 30 per cent of the 
cases, and the otherdeviations may be tabulated as follows: 


Exact correspondence or within 5 1.Q. = 69.2% 
10 1.Q. = 89.6% 


is9 is4 ifs “ce 15 Te Q. — 95. 2% 
- as eo eOASO. = 08.0% 
“ “ce cc ce 25 A (e Q. = 98 19% 


It should be borne in mind, however, that at different 
life ages, I. Q. changes of the above magnitudes will 
possess different equivalent age values. 

These figures serve as a fairer basis of comparison in 
determining the discrepancies between I. Q. as deter- 
mined by the Binet and the block-design tests. (Again 
the comparison is not a fair one in view of the existing 
controversy over the constancy of the I. Q. The writer 
has been unable to find material which would be exactly 
comparable.) 

Taking the date of Table LX XII (p. 183) the follow- 
ing agreement and divergence of I. Q. are found: 

TABLE LXXXIV 
I. Q. DIVERGENCES 


Per CENT Bret I. Q. Pornts HicHeEr |} Binet I. Q. Pornts Lower 
Exact Cor- 
RESPONDENCE?] fo 20 


9.0 5:5 
Total — 37.2% Total — 39.4% Total 


50 Io 


-3 || 18.0 


11.8 


Boe Bry oe | 2028 


4.6 


2.5 


2Frequency interval is ro I. Q. 


1¥For additional interpretations of this condition see E. A. Doll: 
“The Growth of Intelligence,”’ Psychological Monographs, Vol. 29, No. 2, 
1921, 130 p., especially Chap. III. 
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Or presented in another form: 
Exact correspondence or within 10 I. Q. = 62.3% 
es is 201.Q. = 83.1% 
“cc cc ce “ee 30 - CL = 93.2% 
6c 6 13 ““ 40 ‘? Q. Sa 98.4% 


A better balance between the per cent of negative and 
positive divergencies is observable here, and also a greater 
spread of variability than is the case with I. Q.’s derived 
from consecutive Binet testings. 

(b) sThe Method of Critical Ninths: A determination 
of discrepancy may be obtained by an analysis of a dif- 
ferent sort. Every table presenting the relation between 
the frequencies of two variables may be divided into nine 
parts, Q: and Qs for both serving as the dividing lines. 
Q: and Qs divide any distribution into three portions low, 
middle, and high. Consequently nine groups are possible, 
thus: 


VARIABLE (r1) 


Qu Qs 
Low MmpLe Hick 
o> i 1 2 M, Hy, H, He 
qi Qs (critical cases) Qs 
qi 
9g Li M2 M; M2 Hy M2 
of SON oe ak a 
ates Li Le M; Le Hi Le 
y (critical cases) 
Qa Qs 


For two tests which supposedly are expected to meas- 
ure the same trait, Li He and Hi Lz may be regarded as 
the critical sectors in which as small a proportion as 
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possible of cases should be found. Every case found 
within these limits is a clear argument against the validity 
of a newly devised instrument, when measured against 
one which has already been established (assuming that 
the already-established instrument is absolutely reliable). 

Applying this criterion of validity to the data of Table 
LXX, the following percentages are obtained: 


Variable (1) Binet Age 
Variable (2) Block-design Age 3 


Critical Cases 
Li He = ) (0%) 
Hy, Ly = 2 (.5%) 
Total = 0.5% 
Correspondence 
Ey L.)= 65 (16.7%) 
Mi M2 = 129 (35.3%) 
Mi He = 71 (19.4%) 
Total = 71.4% 


In order to make these values comprehensible in terms 
of other correlations, the percentage of critical cases for 
the Binet and Vocabulary! and for Army Alpha and 
Stanford-Binet Age? will be presented: 


Variable (1) Binet Vocabulary 
Variable (2) (631 cases) Binet Age 


Critical Cases 
Li He =0 
Hy, Ly =o 


Total = 0% 


11. M. Terman: ‘The Intelligence of School Children,” p. 310. 
2R.M. Yerkes: “Psychological Examining in the Army,” (Memoirs, 
Nat. Acad. of Sciences, vol. 15, 1921, 890 p.), p. 621. 
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Correspondence 
L, Le = 145 (23.0%) 
Mi Mz = 244 (38.7%) 


Hi He = 113 (17.9%) 
Total = 79.6% 


Variable (1) Stantord-Binet Mental Age 
Variable (2) Alpha Raw Score (653 cases) 


Critical Cases 
L, H, =O0O 
Hy Ly = 1 (.15%) 
Total = 0.15% 
Correspondence 
Ii Ly = 104 (15.90%) 
My M2 = 273 (41.87%) 
Hi Hz = 99 (15.2%) 
Total = 72.9% 


It is apparent that a close correspondence exists be- 
tween the evaluations of intelligence (in terms of Binet 
mental age) on the part of the vocabulary test, the army 
alpha, and the block designs. 

Finally, the same analysis is presented for Binet I. Q. 
and Block-design I. Q. (data of Table LX XII, p. 183). 


Variable (1) Binet I. Q. 
Variable (2) Block-design I. Q. 


Critical Cases 

L, He = 2(.5%) 

1 lg =o 
Total = 0.5% 

Correspondence 

Li Le = 73 (19.9%) 

Mi Me = 331 (35.8%) 

Hy He = 51 (13.9%) 


Total = 69.6% 
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(c) Graphic Analysis: For a graphic presentation of 
discrepancies the life ages of 14 and g have been selected 
—age 14 because this life age had the largest single 
number of feeble-minded below age 17 (see Table I) and 
age g purely at random. An analysis of Graph 43 indi- 
cates the existence of a number of conditions: 

(r) A mild process of compensation is operative, some 
who have low I. Q. on the Binet, obtain high I. Q. on 
the block designs and vice versa (especially true of the 
g year-olds) ; 

(2) Low Binet I. Q. are often coupled with still lower 
B. D. I. Q., and high Binet I. Q. are often found in con- 
junction with still higher B. D. I. Q. 

(3) The larger proportion, however, manifest little, 
if any, discrepancy between the two I. Q. 

It will be observed that the range of I. Q. in the block- 
design tests is considerably increased. This has its 
disadvantages, but from a clinical point of view this char- 
acteristic is a desirable one, because of its bearing upon 
the differentiation of the inferior and the superior. 

Summarizing this discussion of discrepancy, it may be 
stated that although the results of the block-design test 
do not tally exactly with those of other measures of intel- 
ligence, nevertheless, agreement is close enough to grant 
the block designs a fair degree of validity, the instances of 
disagreement being in themselves sufficiently crucial to 
require a psychological analysis apart from the tests 
themselves. 


This concludes the discussion of validity. A number 
of criteria have been utilized, each differing in weight and 
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in general importance. In reality the only effective acid 
test is the pragmatic one. If the tests will be found to 
work, that is all that the most critical ones of us demand. 
The array of evidence just presented seems to indicate 
not only that the tests measure intelligence, but that this 
is accomplished with a fair degree of accuracy. On the 
other hand, one should bear in mind Stern’s caution:! 


“Psychological tests must not be overestimated, as if 
they were complete and automatically operative meas- 
ures of mind. At most, they are the psychographic 
minimum that gives us a first orientation concerning 
individuals about whom nothing else is known, and they 
are of service to complement and to render comparable 
and objectively gradable other observations — psycho- 
logical, pedagogical, medical — not to replace these.” 


3. DIAGNOSTIC VALUE OF THE TESTS 


It has been intimated a number of times by writers of 
varying degrees of expertness and reliability that an 
estimate of intelligence based upon the use of a single 
measuring instrument is inclined to be less accurate than 
one based upon the application of a number of such 
diagnostic tools. In fact, a frequent failure upon the 
part of numerous psycho-clinicists is to disregard other 
important criteria for the proper diagnosis of intelligence 
or of mental deficiency and to rest content with the 
results of a single test, somewhat mechanically evaluated. 
This is especially true of feeble-mindedness. No diagno- 
sis of this condition is adequate which has not included 


1“ The Psychological Methods of Testing Intelligence” (Warwick 
and York, 1914), p. 12. 
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weighing the evidence in other fields than the psycho- 
logical. Thus a verdict of feeble-mindedness which is 
not supported by evidence of vocational impotence, of 
educational failure, of social incompetence, of biological 
taint, is, except in rare and exceptional instances, quite 
weak and untenable. 

The issue also has been raised whether we have not 
overemphasized the verbalistic tests with the inevitable 
injustice to those who may be laboring under a language 
handicap. Without desiring at this point to enter any 
evidence for or against the reasonableness of this con- 
tention, other than that already presented in this mono- 
graph, it does seem wise to utilize tests which measure 
intelligence through “performance” as well as through 
“language.”’? The combined results of an inquiry in 
both these directions seem to indicate a closer approxi- 
mation of what is the actual mental age of a subject, than 
if either is used alone. 

On the other hand, it is plainly evident that no “‘per- 
formance”? test yet devised measures intelligence as 
adequately or with as high a coefficient of efficiency as 
the Binet or two or three other “language” tests. Of 
course, the standards upon which our judgments of 
efficiency have been based may be unsatisfactory, e.g., 
school progress, teachers’ estimates, school marks, etc. 
At any rate, looking at the matter from a practical point 
of view, few, if any, clinical psychologists would be free 
to abandon our so-called “language” intelligence tests 
for the exclusive use of “performance” tests in classifying 
children and in making diagnoses of mental deficiency. 
At present, performance tests are of chief importance as 
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corroborative and supplementary sources of information. 
This probably will hold true for some time to come. 


4. SERVICEABILITY 


In his “Stanford Revision of the Binet-Simon Scale” 
(Warwick and York, 1917) Terman states,! that “to 
be widely serviceable a test should demand only the sim- 
plest material or apparatus, should require at most but 
a few minutes of time, and should lend itself well to uni- 
formity of procedure in application and scoring.” The 
writer has attempted to satisfy these demands in stand- 
ardizing the block-design tests. Those who utilize the 
tests will find after a little practice that there can be but 
little variation in the findings of two examiners, and that 
the only chance for difference is in the recording of the 
number of moves made. 

The special value of the block-design tests lies in the 
fact that valid results may be obtained independently of 
the “language factor.”” Neither deafness nor lack of 
language-understanding should be disqualifications in 
the proper performance of the test. The block designs 
may therefore be utilized in the study of racial differences, 
in determining the mental capacities of the deaf and of 
those suffering from various other language handicaps. 

As regards the borderzone problem, it appears that this 
test will aid in a better differentiation of the group of 
cases falling in this category. The writer maintains that 
feeble-mindedness is mot an arbitrary statistical designa- 
tion, but is rather a clearly demarked physiological entity 
quite distinct from normality, statistical psychologists 

DESO: 
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notwithstanding. Years of experience with this type of 
defect has fixed the notion in the writer’s mind that 
feeble-mindedness is indicative not only of mental mal- 
functioning, but also of physiological mal-functioning 
possibly of endocrine character. The results of fur- 
ther research, however, can be the only tests of the truth 
of one’s statements at this time. 


CHAPTER VI 


Supplemental Observations 


1. Average Mental Age of Adults 

2. Increasing Divergence versus Parallel Progress of 
Mental Development - 

3. A Performance Intelligence Scale 


I. AVERAGE MENTAL AGE OF ADULTS 


OF importance in interpreting the results of this newly 
devised mental test is the recently raised question regard- 
ing the average mental age of adults. The current prac- 
tice of regarding 16 years as the age when intelligence- 
maturity is attained, and the age characteristic of the 
American population at large, has been adhered to in 
the standardization of the block-design tests and in the 
interpretation of scores derived therefrom. 

The results of army testing have thrown some question 
upon the tenability of this standard, and although 
previous to the testing in the army criticism of the 16- 
year criterion emanated from certain quarters,! no great 
importance was attached to these attacks, clinical psy- 
chologists continuing the practice of regarding 16 years 
as the intelligence of the average adult. The results of 
army testing, due to the overwhelmingly large numbers 
examined, are likely to receive greater recognition and 

1 See controversy between J. E. W. Wallinand S.C. Kohs in Journal 


of Amer. Institute of Criminal Law and Criminology, 1916, vol. 6 and 7. 
227 
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may be regarded by some as unalterably conclusive. 
The army tests indicated that the average mental age 
of adults, especially utilizing the figures of Group X, a 
supposedly random sampling of 653 men, is 134 years.! 

The attempt will here be made to present reasons why 
we should exercise caution in accepting this level as 
average, advising instead the continued use of the 
16-year standard until further experimentation has been 
carried on to decide the issue finally. The reasons for 
questioning the 1314 estimate will be listed seriatim, 
and have not been arranged in order of importance but 
rather as they suggested themselves to the writer. 

(1) It is advantageous in measuring intelligence to 
utilize a tool which will not present adaptive difficulties 
for the person examined. Thus familiarity, previous 
experience, specialized imagery, the peculiar mechanics 
of the test itself may make it easier for some to obtain 
satisfactory scores to whom the technique of the test is 
adapted, and, on the other hand, more difficult for those 
to whom the test procedure and its attack are strange 
and unfamiliar. The army test, together with the con- 
ditions under which it was taken, in and of itself requires 
“‘an adaptation to a new situation” which is quite com- 
plex. All subjects will not adapt themselves similarly. 
This condition introduces a spurious factor likely to 
underweight the performance of those below average in 
mental ability, with the inevitable result that the general 
average is reduced. An ideal test of intelligence measures 
“ability to adapt oneself to a new situation,” but is not 


1R, M. Yerkes: “Psychological Examining in the Army,” Memoirs 
National Acad. of Sciences, pp. 195, 790. 
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itself a matter to which “adaptation” is required. In 
this respect the army tests may be said to fall short, 
a correcting formula being necessary to compensate for 
this “drag” upon sub-average ability, when determining 
the average capacity of a group examined. 

(2) A matter deserving serious consideration at this 
time when group testing has deservedly gained such great 
popularity, both for analyses of intelligence level and of 
pedagogical achievement, is what the writer. has termed 
the “theory of progressive score reduction.” <A tacit 
assumption generally made in group examining is that 
ability manifested in a group-test will very closely cor- 
respond to the same level of ability attained in an in- 
dividual examination. Regression tables and correlation 
coefficients are presented as evidence bearing out this 
contention. A close analysis of the situation will, 
however, reveal the existence of this condition: Whereas 
a high score in a reliable group intelligence test is un- 
questionably indicative of that mental level, because 
superior scores cannot be obtained by accident or 
haphazard, the same does not hold true for low scores. 
One hardly dare state that a low score is zpso facto the 
inevitable performance of an inferior mentality. Any 
number of factors may have entered to reduce this score. 
The chances are that the lower the examinee’s intelligence 
the greater are the number of these ‘‘reducing”’ factors; 
and vice versa, the higher. the intelligence, the lower the 
number. The actual situation may be pictured graphi- 
cally. 

To make this graph clear, let us assume that we have 
applied the Binet tests to a large number of subjects and 
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we select eleven whose intelligences are respectively, 
6, 8, 10, 12, 14, 16, 18, 20, 22, 24, 26.1 The median 
mental age here will be observed to be 16. Let us also 
suppose that this large group, in which these eleven are 
included, have been given Army Alpha. It is the writer’s 
contention that the lower the actual mental ability of the 
subject examined, to that extent will his score in the 
group test deviate from his true mental age. According 
to Graph 44, the subject testing 26 on one test will, 
supposedly, test exactly the same on the group test. 
For the other ages. 

a 24 Binet will possibly measure 23144 

a 20 Binet will possibly measure 18144 

a 16 Binet will possibly measure 1344 


a 12 Binet will possibly measure 814 
an 8 Binet will possibly measure 34% 


GRAPH 44 


io Reduction 
saan Test 20 24 26 


(Binet) 
toad fo Ti 
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The median performer who on the Binet obtains an 
intelligence rating of 16, may on the group test, because 
of this phenomenon of progressive score reduction, ob- 
tain an intelligence rating of barely 14. (The material 

? The writer is aware that the Stanford-Binet cannot yield such high 


mental ages except through the predictive use of the I. Q. But for the 
purposes of this presentation, this deficiency will be overlooked. 
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of the graph has been made to conform with the possible 
condition of the figures obtained from the application 
of Army Alpha.) It should be noted that the data of 
Graph 44 would yield a correlation coefficient of + 1.00, 
yet it would not reveal the increasing inaccuracy of the 
group intelligence examination with the decrease in the 
mental ability which it has been devised to measure. 

(3) It cannot be denied that the Army Alpha over- 
weights reading ability. Those who have difficulty in 
reading, or in translating the printed word into more 
familiar imagery, may be expected to obtain lower 
scores than on an individual test like the Binet. Evi- 
dence of this was clearly revealed by the fact that going 
from Army Alpha to the Combined Scale did not yield 
the same results in terms of Combined Scale scores, as 
going from Army Beta to the Combined Scale. In the 
Beta test (performance) those possessing the mental 
ability had a more satisfactory opportunity to manifest 
it than with Alpha. So that in the case of Alpha both the 
dull normals and inferiors, together with those laboring 
under language handicaps of whatever form, tended to 
slide toward the lower end of the frequency distribution. 

Attention, in this connection, is called to the recent 
experience of Whipple! with three pupils who obtained 
a mental age from one to three years lower on the 
National Intelligence Tests than on the Stanford-Binet. 
Quoting: 

“These three cases strongly suggest, what would be 
a priori intelligible, that pupils who have special difficulty 


1G. M. Whipple: “The National Intelligence Tests,” Journal of 
Educ. Research, 1921, 4: 18-31. 
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in reading will suffer a decided reduction in menta: age 
rating by a group intelligence test when compared with 
their rating by the individual and oral examination of 
the Binet, though it remains possible that the former 
rating may be the more significant in predicting school 
progress.” (P. 31.) 


(4) The assumption that the draft represented a fair 
cross-section of the American population is admittedly 
unwarranted. The frequency tables from which the 
average intelligence of the American citizen is deduced 
does not include the figures for officers of all grades. 
It should also be recalled that thousands of professional 
men, and those engaged in essential industries were 
exempted from service and were consequently free of 
the draft. If we can regard a man more intelligent be- 
cause he has taken on family responsibilities and has 
been exempted because he is engaged in caring for those 
dependent upon him, then this is another very large 
and important group whose range of ability is not 
adequately represented in the total results. 

(5) It is a recognized fact in psychological testing- 
technique that the physical conditions under which a 
subject is working may have a very profound effect 
upon the result achieved. It perhaps will not be ques- 
tioned that the experimental conditions at the various 
draft camps were with few exceptions very far from 
ideal. It was recognized that the failure of the War 
Department to provide special buildings for psycho- 
logical examinations proved a very serious handicap, 
and the facilities which were extended interfered con- 
siderably with the effectiveness of the work. Among 
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the factors which might be expected to affect the results 
were the following: 

(a) Examinations followed at varying intervals after 
inoculation for typhoid, influenza, etc. at various camps; 

(b) The same degree of variation was characteristic 
for the time of examination after arrival; 

(c) In some camps men were examined with a full 
equipment of apparel including the heavy top-coat, in 
others.men were in their shirt sleeves; 

(d) Sitting on the floor, tailor-fashion, some on mats, 
some against posts or the wall for support, others with- 
out mats or back-supports, may have had some influence 
upon the results; | 

(e) The use of beaver-boards for hand-rests may have 
had a varying influence upon efficiency; 

({) The preéxamining conditions, physical and mental, 
may possibly have been a factor which should be con- 
sidered ; 

(g) The light, air, comfort, and physical properties 
of the various buildings which served as examination 
centers were variable quantities which also may have 
some bearing upon the interpretations of the final 
averages. 

It might be well to state before continuing, lest the 
writer be misunderstood, that these remarks are not 
made in criticism of the splendid work which was ac- 
complished by the Psychological Division of the Army, 
but an attempt is being made to interpret the statistical 
evidence that the average mental age of adults is 1314 
years. In view of the difficulties and handicaps which 
were inevitable and insurmountable, we should be 
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cautious in carrying over this result to the field of clinical 
psychology, overturning standards which have been 
current practice for a good many years. Let us first 
check these averages for scientific validity. 

(6) A necessaryelement in all group testing is “speed.” 
Experimentation with the army tests has thus far re- 
vealed that “speed” and “intelligence” are fairly well 
correlated, and that doubling the time in Army Alpha, 
for example, does not materially change final rankings. 
It should be borne in mind, however, that possibly 
“speed” has been overweighted in the army tests. In 
fact it is admitted that ‘‘assuming that we are dealing 
with an unselected group, Table LXXIX shows that 
some limit between double and single time would prob- 
ably be more suitable.” ! There is considerable question 
now regarding the relative values of ‘‘speed” versus 
“power” tests. There are many who insist that “speed” 
should be made subordinate to “‘power.” In view of 
the possible overemphasis upon speed in the Army Alpha 
tests, together with the difficulty of discounting it ac- 
curately, perhaps we had better await further experi- 
mentation before accepting the intelligence-average as 
found. 

(7) For a number of years it has been the practice of 
clinical psychologists to subdivide the feeble-minded 
into three groups: idiots, imbeciles, and morons. The 
mental age limits for these groups are: idiots, from below 
age one to age two; imbeciles, ages three to seven; 
and morons, ages eight to twelve. According to the 


1R. M. Yerkes: ‘Psychological Examining in the United States 
Army,” p. 420. 
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data of the army examinations, if all those testing less 
than twelve are designated feeble-minded, then 30.3 per 
cent would be so classified. This, of course, is absurd 
and unthinkable. We have been ready to admit that 
approximately the lowest two per cent of the population 
is mentally unfit to manage itself and its affairs with 
ordinary prudence. On this basis the army examina- 
tions indicated that those testing below eight amounted 
to 2.1 per cent. To reverse our reasoning and to contend 
that any one with a mental age of eight or over is men- 
tally fit to manage himself and his affairs with ordinary 
prudence is to lead to another absurdity belying the 
facts of our daily experience. 

We are therefore confronted with two horns of a 
dilemma, from which there seems no clear-cut escape. 
If it is true that 1314 years is the average mental age of 
adults, and if it is true that 8 years is the line of demarca- 
tion for those who are feeble-minded, then we should be 
prepared to empty our feeble-minded institutions of at 
least one-fourth of their present populations. We should 
also proceed immediately to change the I. Q. classifica- 
tions of intelligence. Instead of an I. Q. of 70 or 75 
being indicative of feeble-mindedness (utilizing 16 years 
as the devisor for adults), the I. Q. of 60 should be 
adopted (1314 years being the highest divisor possible). 
Similar revisions should be made for the other groups. 
The moron feeble-minded, then, has been a pure figment 
of the imagination! The statistical result of the army 
intelligence tests veritably ‘“‘knocks the props from 
under” the customary 2 per cent criterion, the I. Q. 
of 70 as indicative of feeble-mindedness, it annihilates 
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the moron group, and weakens in its entirety the psycho- 
logical criterion of feeble-mindedness. On the basis of 
army findings many may be designated “normal” men- 
tally whose social, pedagogical, industrial, and hereditary 
history clearly indicates “feeble-mindedness.”’ Whereas, 
heretofore, the psychological criterion has been recog- 
nized as generally the most valuable of them all, it may 
now become the least significant. Engaged daily and 
for years in the handling of social misfits, the writer will 
be slow to abandon established standards until the newer 
ones are more carefully checked both for reliability and 
practicability. It may be true that in the army seven 
to ten-year-olds functioned more or less efficiently, and 
that comparatively low intelligences on the army tests 
reported successful living at-large, yet clinical psycho- 
logists will recall few, if any cases, testing seven to ten 
years on the Binet who manifest such successful adapta- 
tions to the complexities of their environment. It is 
true, of course, that because of the nature of our work we 
manage to learn only about the unsuccessful morons. 
Much more satisfactory evidence must be presented, 
however, to convince one that the successful moron 
requires no supervision and direction, and actually 
guides his affairs with ordinary prudence. 

(8) Because of the constant need for substitutes for 
the Binet test on account of previous examinations, 
possible coaching, etc., the writer has had more than two 
years’ experience applying group tests, such as the Army 
Alpha, the Haggerty, the Illinois Examination, the 
National Intelligence Tests, and so on, to individual 
subjects. It has been amazing to find, after the pre- 
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scribed instructions had been read, the frequency with 
which additional explanations had to be given before 
the subject could proceed intelligently. There have 
been occasions where a whole test — for example, the 
disarranged sentences (true and false), of Army Alpha — 
had been entirely misunderstood. In this instance all 
items were underlined “false.”” The experimenter then 
explained the problem more thoroughly, the subject this 
time placing on record a truer representation of his 
degree of mental ability. Such procedure in group 
testing is, of course, impossible. Set directions are pre- 
scribed. If they are understood, well and good; if not, 
the matter cannot be helped. No questions can be enter- 
tained. It is a credit to all the group tests now in use 
that the directions are remarkably clear and under- 
standable. But in every group of two hundred, a few 
will be found who will not quite get the idea, and when 
averaging results these records give a false weight to the 
figures. 

(9) An adequate treatise dealing with the psychology 
of the crowd would be a valuable asset assisting in the 
interpretation of the army test results. As yet such an 
analysis is lacking. We can only speculate upon the 
nature of an individual’s mental composition when 
handled merely as one in a large group. If we were to 
contrast individual psychological examining with group 
testing, it would not be unfair, perhaps, to state that the 
circumstance of the crowd is not conducive in all cases 
to maximum mental effort. There are a host of subtle 
factors brought into play which it has not yet been 
possible for scientific psychology to catch hold of. Some 
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instincts such as rivalry may make for extraordinary 
exertion and increased efficiency; on the other hand, 
there are other counteracting instincts which might just 
as likely lead to decreased efficiency. In what direction 
the total balance lies, whether favorable or unfavorable, 
cannot be dogmatically stated. It is natural to expect 
that under the best conditions one cannot exceed one’s 
native ability. On the other hand, native ability may 
not become manifest under certain restricted conditions. 

(x0) The most important check upon the results of 
the army testings were the Stanford-Binet ages of 653 
draftees from nine different camps. This group has pre- 
viously been mentioned, and was designated in the army 
statistics as Group X. The supposition was made that 
this is a random sampling and is typically representative. 
There are a number of reasons why this sampling should 
be questioned. These follow: ~ 

(a) It is significant that with a possible maximum 
score of 414 in Army Alpha (weighted) no one of this 
group received a higher score than 360, and with a possi- 
ble maximum of 212 (unweighted) no score was higher 
than 180. (P. 779-780.)! 

(b) No member of Group X had a schooling record 
beyond four years of college. It is admitted that the 
upper range, both for mental ability and for schooling, 
is not here represented. (P. 770.) 

(c) Men of foreign birth had been eliminated. (P. 780.) 

(d) The total group (653) included a number of 
illiterate men. (P. 781.) 


1 These page references are to R. M. Yerkes: “Psychological Exam- 
ining in the United States Army.” 
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(e) Group X failed to include mer who were selected 
as officers or for prospective officer-material. And be- 
cause of the operation of the draft it was inevitable that 
many men, because of physical or mental handicaps, were 
thrown in the discard and never reached a training camp. 
To what extent a normal distribution is disturbed by 
these selective processes is a matter still to be deter- 
mined. 

(f) This group is admitted defective as a sample on 
p- 384. “In the first place, the group chosen in any given 
camp cannot be thought of as typical of the camp; and 
in the second place, there was the selection involved in 
the choice of camps.” 7 

(g) The attempt was not made to set down first the 
earmarks of a satisfactory sampling and then adhere 
closely to the prescription. No effort was made for a 
proportionate selection, covering the whole range of 
mental ability. It was felt, rather, that the heterogeneity 
of the group was a sufficient guarantee of the adequacy 
of the sampling. (P. 779.) 

Whatever averages are obtained from Group X must 
be interpreted with the above facts in mind. 

(11) The pragmatic test has supported the 16-year 
criterion. The calculation of the I. Q.’s of adults and 
the classifications inevitably resulting from the use of 
this standard have met with rather general satisfaction 
among clinical psychologists. The utilization of test 
statistics gathered in the army for the interpretation of 
mental capacity is well illustrated in the following report! 


1From the Survey of Saturday, Oct. 30, 1920 (Vol. XLV., No. 5), pp. 
147-148. 
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which is quoted in full. We may naturally expect very 
strange generalizations such as are here propounded: 


“Prisoners vs. ‘Men Generally’ 


“One of the most significant contributions made to 
the science of penology since Dr. Charles Goring’s monu- 
mental report on the criminal type, seven years ago, is 
the recent report of the Mental Survey of Penitentiary 
Prisoners in Illinois. Dr. Goring’s report completely 
repudiated the existence of a uniform physical criminal 
type, and established to be an illusion the doctrine which 
for a previous quarter of a century had done an incal- 
culable damage to penal reform. 

“This new mental survey, under the direction of Dr. 
Herman Adler, the criminologist, dispels the existence of 
a uniform mental criminal type. The basis of comparison 
in the Goring report was the physical characteristics of 
law-abiding citizens such as college students, soldiers, 
hospital patients, and the like; the basis of comparison 
in the Adler report is the result of the group mental tests 
applied to the United States Draft Army, comprising 
some 1,700,000 men of draft age from all sections and 
classes and racial groups in the United States. The 
report asserts that the result of the army test is an index 
of the average mental age of the people of this country. 

“Tn the Illinois survey the conclusions drawn were on 
the basis of 1,650 accurate records of prisoners examined 
by army tests. Four and one-half per cent were in the 
lowest group—four per cent in the highest. In the 
penitentiary the inferior group was 16 per cent —in 
the draft army, 25 per cent. The striking fact is there- 
fore revealed, that the penitentiary has fewer men of 
inferior development than the draft army, and that it has 
more men of superior mental development. 

“The report further shows: Relatively few inferior 
men, relatively many superior men in the crimes of fraud 
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and crimes against property; the reverse in case of sex 
crimes; the short-termers an average group; the long- 
termers often either superior or inferior with a larger 
percentage of inferior. Those prisoners who had 
served previous terms had half as many inferior types, 
and nearly twice as many superior types as those prison- 
ers without previous records of arrest. 

“Among the reformatory prisoners the comparative 
results are much the same. The average age is lower and 
accounts for the existence of fewer superior. men in the 
reformatory than in the draft army. 

“Tf the analogy is correct that the American draft 
army is an index of the country, it is evident from this 
report that as a group, the prison population is not 
inferior to men generally.” 


In contrast to this analysis, in which it is demonstrated 
practically that penitentiary prisoners in Illinois are 
superior to men at large, are the findings of Goring,! 
of Fernald, Hayes, and Dawley,” of the NewYork Prison 
Survey Committee,’ of Miner,* of Williams,’ and of 
Healy.6 The testimony of this group cannot very 
easily be controverted. 


1C. Goring: ‘The English Convict” (abridged edition), London: 
His Majesty’s Stationery Office, 1919, 275 pp. 

2Mabel R. Fernald, Mary H. S. Hayes, and Almena Dawley: “A 
Study of Women Delinquents in New York State” (New York, Century 
Co., 1920, 542 pp.). 

3 Report of the Prison Survey Committee. (Albany, N. Y.: J. B. 
Lyon Co., 1920, 412 pp.) 

4J.B. Miner: ‘Deficiency and Delinquency.” (Baltimore, Warwick 
and York, 1918, 355 pp.) 

5 J. H. Williams: ‘The Intelligence of the Delinquent Boy,” Jour. of 
Delinquency. Monograph 1, Jan. 1919, 198 pp. 

6 William Healy: “The Individual Delinquent” (Boston, Little, 
Brown & Co., 1915; 830 pp.). 
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The following from Goring: 


“Tt is clear that the relationship between mental de- 
fectiveness and the committing of all types of crime, with 
the exception of some kinds of fraud, is an extremely 
intimate one. The strength of this bond transcends 
that of any we have hitherto been able to discover: and 
it is evident that defective intelligence is one of the 
primal sources of crime in this country.” (P. 181.) 

And again, : 

“Probably the chief source of the high degree of rela- 
tionship between weak-mindedness and crime resides in 
the fact that the criminal thing which we call criminality, 
and which leads to the perpetration of many, if not of 
most, anti-social offenses to-day, is not inherent wicked- 
ness, but natural stupidity. At any rate, we need only 
study the penal records of habitual criminals to realize 
fully that the one characteristic of the offenses of go per 
cent of the 150,000 persons convicted to prison every 
year — the one characteristic, apart from their intoler- 
ableness in a well-ordered society, is the incredible stu- 
pidity of these offenses.” (Pp. 182-183.) 


And finally, 


“Our final conclusion is that English criminals are 
selected by a physical condition, and a mental constitu- 
tion which are independent of each other — that the one 
significant physical association with criminality is a 
generally defective physique; and that the one vital 
mental constitutional factor in the etiology of crime is 
defective intelligence.” (P. 184.) 


Next, Fernald, Hayes, and Dawley: (The comparison 
here was made direct with Group X.) 
“Tt is evident from consideration both of the distribu- 


tion and of the means that the delinquent group is in- 
ferior mentally to the army group.” (P. 4109.) 
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“The difference in mental age of 1.6 years (Group X 
— 13.4 years, New York delinquent women — 11.8 
years) may be accepted as valid, beyond any reasonable 
question, since it amounts to more than ten times the 
standard deviation of the difference.” (P. 420.) 

And in summary, remembering that these statements 
refer only to white English-speaking groups, “the average 
mental capacity of the delinquent women whom we have 
examined is lower than that of any groups of non- 
delinquent adults with regard to whom we have data,” 
and ‘‘the above statement does not imply a selection of 
individuals entirely from the lower end of the scale of 
intelligence for the delinquent group. There is, in fact, 
an extensive amount of overlapping of the delinquent 
with the non-delinquent groups.” (P. 433.) 

And in conclusion, “It is evident from the foregoing 
statement that our findings are in accord with Goring’s 
as regards the fact of a difference and its direction. They 
indicate, however, a slighter degree of difference than 
he implies.” (P. 434.) 


Of course, this smaller difference is inevitable in view 
of the reduction of the standard. 

These quotations are from the Prison Survey Com- 
mittee of New York: 


“‘A large section of the prison population consists of 
custodial rather than punitive cases. The prisoner who 
is mentally or physically unable to cope with the condi- 
tions of a free society should not be allowed to complete 
the cycle of commitment, release, and recommitment, 
and indulge between times in a criminal career as the 
only means within his knowledge of obtaining a liveli- 
hood. Dr. Glueck, after a study of 602 cases at Sing 
Sing Prison, found that 28.1 per cent showed intelligence 
equivalent to that of the average American child of 
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twelve years or under.! Examinations made in various 
prisons and reformatories, as shown by the State Prison 
Commission for 1918, estimated from 15 per cent to 25 per 
cent of the prison population as segregable on account 
of mental deficiency. These figures, taken in connection 
with the fact that the same report states that 87 per cent 
of the felons admitted to the prisons in 1917 had served 
previous terms, make obvious the fact that a large per- 
centage of those who are released are incapable, either 
from certain mental defects or from lack of training in 
the institutions, of maintaining themselves in society. 
It is believed that before any great advance can be made 
in the training of prisoners the mental deficients must be 
sorted out, segregated, and dealt with as a separate unit. 
Elementary, advanced, and industrial education, wage 
incentives, self-government, and parole measures will 
be of little avail with this class of prisoners, whose 
mental limitations prevent them from taking advantage 
of any privilege or opportunity.” (P. 104.) 

One is interested to inquire to what extent this general- 
ization applies to approximately half the American popu- 
lation, for the data of Group X, if regarded as represen- 
tative of the country at large, indicates that only 52.7 
per cent of American citizens are 13 years mentally or 
over! And again on p. 114 we find the remark, “From 
the figures obtained from various penal and correctional 
institutions, and from the examinations made by the 
Prison Survey Committee, it is believed that from 8 to 
14 per cent of the prisoners, other than those in insane 
hospitals, are mental defectives requiring institutional 
care.” 

And now these remarks of Miner, whose regard for 
careful statistical analyses is a high guarantee of the 
soundness of his generalizations: ‘In the face of the fact 


1Those of Group X under 13 years mentally amounted to 47.2%. 
Almost twice as many! 
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that mental deficiency is undoubtedly the most impor- 
tant single factor to be considered today in the institu- 
tional care of delinquents, one hesitates to correct even 
oe at exaggerated impressions as to its importance.” 
367. 

“On the basis of our summary of tested delinquents in 
the last chapter it seems extremely conservative to sup- 
pose that to per cent of the manifest and potential 
criminals are as deficient mentally as the lowest 1.5 per 
cent of the general population. Even with this assump- 
tion, we find that the chances would be 48 out of a hun- 
dred that a person of this degree of deficiency would be 
convicted of crime.” (P. 216.) 

“The most significant fact demonstrated by the corre- 
lations between juvenile delinquency and deficiency is 
that there is a positive relationship which is significant 
in amount. With the maximum estimate the correlation 
is nearly six times its error. This is the first time that 
the relationship has actually been calculated in connec- 
tion with any group of juveniles.” (P. 223.) 

And in his conclusions, “‘We have summarized some 
of the best and most recent investigations in which 
a notable advance toward solving this problem has been 
made by means of the correlation method. This has 
proved to be a new and vigorous force for directing social 
progress. By no other method have we approached so 
near the solution of the cause of delinquency. It enables 
us to restate the problem of criminality as mainly a 
problem in the treatment of a hereditary criminal dia- 
thesis, in which mental deficiency is the largest factor.” 
And then by way of a final word, “Unless the present 
evidence, however, is outweighed by improved data 
obtained in the future, the most strategic point for 
attacking persistent delinquency is through the relation 
to deficiency, with heredity holding the heights.” 


(Pp. 244-245.) 
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The following are four of the conclusions of Williams: 


““(2) That the general level of intelligence among 
delinquent, dependent, and potentially delinquent boys 
is decidedly lower than that of ordinary children and 
adults of the same ages. 

““(3) That feeble-mindedness is much more common 
among delinquent, dependent, and potentially delinquent 
boys than in the population as a whole; and that approxi- 
mately 30 per cent of the delinquent and dependent boys 
included in this investigation are definitely feeble- 
minded. 

“‘(4) That low intelligence among delinquent boys is 
the chief contributing factor in their delinquent conduct. 

“(s) That any level of intelligence lower than that 
of the average-normal accounts in part for delinquency, 
the extent to which it is responsible depending upon the 
degree of intelligence, which may be best expressed by 
the intelligence quotient.” (P. 181.) 

For 1000 young repeated offenders Healy reports “‘as 
beyond peradventure feeble-minded, we found about 10 
per cent, but the figure will be increased as some of the 
younger in the lower groups fail to advance with age.” 
(Pet4o.) 

And again, ‘‘The subject of mental defect is of great 
import in the study of delinquency and its causation. 
Just what percentage of delinquents are feeble-minded 
appears to be a matter of perennial interest, but well- 
founded statistics, even if obtained in particular places, 
may not be applicable to different situations. There can 
be no doubt that separate reformatory or prison popula- 
tions if tested would show from ro to 30 per cent, or even 
more, to be feeble-minded.” (P. 447.) 

“But the gist of the situation is that mental defect 
forms the largest single cause of delinquency to be found 
by correlating tendency to offend with characteristics 
of the offender.” (P. 447.) 
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To return to the report in The Survey, in which one is 
given to understand that the penitentiary prisoners of 
Illinois are equal to men generally in mental capacity, 
if not slightly superior. Analyses such as these contra- 
dict all previous experience, and their cumulative force 
will bring about a distorted perspective, which may only 
confound the layman and the prison administrator in the 
adequate handling of our anti-social and unsocial classes. 

(12) The outstanding advantage of an individual test 
lies in the fact that a rapport between examiner and 
examinee may be established. This is of unquestioned 
value in increasing a subject’s efficiency and in inter- 
preting the results of any given performance. In an 
individual examination failures can be explained more 
adequately, interest, application and distractions can 
be observed, malaise or other discomforts irritating the 
subject may be properly discounted. In a group test 
this is not possible. Your achievement within the forty- 
five minutes is the measure of your intelligence. No 
allowances can be made for any disturbing or distracting 
influences. To what extent the army averages have 
been reduced because of this inaccuracy cannot be even 
guessed. Combined with other reducing factors, the 
surprisingly low average mental age found is, to a certain 
extent, to be expected. 

(13) Applying the ‘‘test of common sense” to the 
1314 standard, although unscientific, it possesses, never- 
theless, a certain degree of validity. So-called “common 
sense”’ is generally a combination of attitudes or points 
of view based upon long experience, both of the individual 
and of the group in which an individual finds himself. 
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Common sense is opposed to the conception that mental 
power reaches its maturity at 1314 years. Even now 
when we tell the layman that intelligence maturity is 
generally reached at 16, he is shockingly surprised. In 
reality, the whole problem of determining at what age 
children reach intelligence maturity is still one awaiting 
solution. It is realized that this objection to the 1344 
year standard is not a very weighty one, yet common 
sense should be considered as one among a number of the 
acid-tests of truth. 

(14) Numerous factors of personality and temper- 
ament probably had varying influences upon the result. 
Such elements as ambition, conscientiousness, obedience, 
application, interest, were forces of variable manifesta- 
tion in some manner leaving an impress upon per- 
formance. The assumption that there was an ultimate 
balance, excesses discounting deficiencies, is perhaps not 
warranted in view of the circumstance that one cannot 
achieve a high score on the basis of any other condition 
than actual mental ability. 

(15) Thus far statistical sanction (the normal proba- 
bility curve) has indicated no error in the 16-year cri- 
terion. If 13% is the average mental age of adults, 
shall we find the same normal distribution of mental 
ages and intelligence quotients with the 1314 year cri- 
terion? Of course, some raise the question why we 
should expect a normal distribution even with the 16- 
year criterion. 

Taking the data of Table 333 (p. 790),1 no mental age 


‘AR. M. Yerkes: “Psychological Examining in the United States 
Army.” 
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of Group X exceeds 19.9 years. That.is the result of the 
Binet examination of 653 men. For the white draft, 
93,955 men, Groups I, II and III (group tests) no mental 
age exceeds 22.9 years. According to the evidence of the 
Stanford-Binet Test, intelligence of 20 or over should be 
found with the following relative frequencies: 


MENTAL AGE I. Q. INTERVAL | FREQUENCY IN 1000 
204-212 126-135 _ 16 
218-234 136-145 ») 


Unless there is a great reduction in average intelligence 
(from 16 to 13) with increase of life age, these ratios of 
mental power (I. Q.) skould be found in a correct 
random sampling of people at large. 

Actually, the highest I. Q. using 1314 as a base does 
not exceed about 147 for Group X, and for the white 
draft, Groups I, IT and III, it does not exceed about 174. 
(From data of p. 790.) 

(16) In order to determine the range of mental ages 
characteristic of adults we may be compelled to fall 
back upon some other measuring device than the Binet 
scale thus far standardized. It is inevitable, for example, 
that no member of Group X will test above 19.9, for the 
reason that a perfect performance of all the Stanford- 
Binet items can yield only a mental age of 19 years. A 
peculiar idiosyncrasy which the writer has not seen 
mentioned in the literature is the possibility of a slightly 
inferior performer obtaining some mental rating out of 
a possible maximum of 1914 years, whereas one who 
passes all the tests in the whole series successfully 
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achieves a maximum of only 19. Thus with a basal age 
of 14, a subject is confronted with 6 tests in age 16, 
each having a value of 5 months, total 30 months; and 
6 tests in age 18, each having a value of 6 months, total 
36 months. The grand total is 66 months, or 5 years 
and 6 months above the basal age 14. This would yield 
a maximum of 19/4 years. On the other hand, with a 
basal age of 16, a subject is confronted with only 6 tests, 
each having a value of 6 months, total 36 months, and 
the maximum is only 19 years. Until the Binet scale is 
more effectively extended into the upper ages, our 
knowledge of the nature and range of mental ability of 
adults will be dependent upon a certain amount of 
speculation. 

(17) On the basis of the army statistics less than 
15 per cent of the draftees examined measured over 
16 years in intelligence. It is difficult to conceive in the 
light of the writer’s ten years’ testing experience that 
85 per cent of adults examined have been below average 
and that only 15 per cent have been above average. If 
memory is not a deceptive servant, experience seems to 
point toward an average closer to 16 than to 13%. 
Whether the experience of other examiners corroborates 
this impression cannot be determined without a proper 
questionnaire. 

(18) The argument may be made that the army 
averages for intelligence are valid because the exemption 
of the feeble-minded counterbalances the elimination of 
the superior men. This is questionable for the reason 
that only the extremest variety of inferior ability was 
eliminated, whereas only a fair degree of superiority 
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was both recognizable as a possibility and a stimulus 
for officership, and in civil life for exemption because 
of indispensable social service. The chances are that the 
processes of selection which yielded Groups I, II, III 
and X favored the selection of those who, on the whole, 
were somewhat below the average of the population at 
large. 

(19) A satisfactory standard of the average mental 
age of adults should include as well statistics gathered 
from the mental examination of women. These ad- 
ditional figures would serve both as a balance and as a 
check upon the averages obtained from the examination 
of men. 

(20) Finally, the danger of accepting the army figures 
on their face value is expressed on p. 790! as follows: 
“The former group is large (Groups I, II and III) and 
representative, but involves an error dependent on the 
fact that these men were examined by alpha and beta 
and not by a mental age scale. The second group (Group 
X) suffers from the fact that it is small and cannot be 
demonstrated to be representative.” 

In conclusion, the writer wishes to express again his 
keen appreciation of the splendid contributions made by 
the psychologists during the war, regretting that condi- 
tions made it impossible for him to share in that epoch- 
making work. The above discussion has been motivated 
only by a desire to reduce the inevitable difficulties of 
clinical psychologists, should we hastily accept the 1314 
age standard. Caution is advised until this question 


1R. M. Yerkes: “ Psychological Examining in the United States 
Army.” 
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of the average mental age of adults, now that it has been 
so forcibly raised, is more satisfactorily settled. In the 
meantime, the ends of clinical and applied psychology 
may be more adequately served, and those engaged in 
the handling of our unsocial and anti-social classes 
may find themselves functioning more efficiently, by 
adhering to the 16-year standard, and by making 
their psychological and clinical deductions on that 
basis. 


2. INCREASING DIVERGENCE VS. PARALLEL PROGRESS OF 
MENTAL DEVELOPMENT 


A great deal of effort is being spent at the present time 
to determine the constancy of the rate of intelligence 
development (constancy of I. Q.). No new material 
will be here presented ‘to enlighten this controversy, 
except to advise the utilization of a more efficient method 
for studying rate changes. In all of the discussions thus 
far, use has been made of equally-spaced cross-section 
paper in order to graph growth and I. Q. changes. This 
has resulted in greatly hindering clear analysis and, to 
an extent, has tended toward the development of mis- 
leading conclusions. A new method for graphing these 
ratios is recommended. 

Psychological and educational studies seem to indicate 
that age and variability are positively correlated. With 
a given increase in age we observe a corresponding in- 
crease in variability. But when the nature of this 
variability has been graphed a number of inaccuracies’ 
have inevitably developed. 
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To illustrate with concrete examples: In his analysis 
of the arithmetic abilities of children, Woody ! states, 
“In the construction of these scales, it has been assumed 
that achievement in the solution of problems in the 
fundamental processes is distributed according to the 
normal surface of frequency. Furthermore, it has been 
assumed that the variability of any grade from the 
second to the eighth is equal to that of any other.” (P. 
30.) Graph 45 illustrates this hypothesis.  - 
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GRAPH 45 


RELATIONS OF GRADE DISTRIBUTIONS TO EACH OTHER IN ADDITION 


Plotted in somewhat different fashion, Graph 46 is 
obtained. It will be observed that progress follows 
parallel lines. Variability does not increase, and pre- 
sumably, children of low ability in all the grades will 
manifest the same difference in comparison with those 
of high ability, throughout. This is one point of view: 


1C. Woody: ‘Measurements of Some Achievements in Arithmetic.” 
Teachers College, Columbia University Contributions to Education, No. 


80, 1916, 63 pp. 
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that there are mental traits which manifest parallel 
progress with increasing age. 
On the other hand, we have the view that there is an 


GRAPH 46 


Parallel Progress of Mental Traits 


increasing divergence of mental traits with incredsing 
age. This is graphically represented by Miner in his 
discussion of intelligence development.! (P. 253.) It 
will be evident from these curves that the bright and 
dull children deviate more and more from the average 
with increase of age. 

To which mode of development does intelligence 
compare? Are there different endowments at birth pre- 
senting a normal curve of distribution, this curve being 
merely reduplicated at higher ages, as in Graph 46; or 
are there different endowments at birth presenting a 


1J. B. Miner: “Deficiency and Delinquency.” 
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normal curve of distribution, which upon increase of 
life age becomes more and more flat as in Graph 47? If 
the I. Q. is constant, then Graph 46 should adequately 
picture I. Q. distributions at various ages. But if for 
the brighter children the I. Q. increases, and for the 
feeble-minded it decreases, Graph 47 would more ade- 
quately represent the true state of affairs. 

Studies of rate of development will not proceed toward 
a clear analysis of the situation until the method of 
graphic presentation changes from the use of equally- 
spaced cross-section paper to that of logarithmically- 
spaced cross-section paper. 

Graph 49 has been derived from Fig. to (p. 75) of 
Doll’s monograph,! only the curves for ages 3, 5, 8 
and to being transcribed. The curves as originally 
presented are indicated in Graph 48. The outstanding 
features of difference between the two methods of presen- 
tation are so obvious that they do not require descrip- 
tion. It will be apparent in Graph 49 that (z) I. Q. 
constancy at all intelligence levels, at all life ages, and 
at all mental ages produces a line possessing a 45 degree 
angle. (2) If the I. Q. increases, the angle inevitably 
increases. (3) If the I. Q. decreases, the angle inevitably 
decreases. (4) These increases and decreases appear in 
the graph in correct, not distorted ratios. (5) The angle 
at which growth proceeds is both an index of I. Q. con- 
stancy as well as a direct expression of rate of growth. 

By comparing Graph 49 with Graph 48 it will be ob- 
served that on evenly-spaced cross-section paper various 
growth curves must be interpreted in terms of the re- 

1E. A. Doll: “The Growth of Intelligence.” 
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spective slopes of specific I. Q.’s, each I. Q. rate having 
a different slope. In Graph 49, however, all slopes, no 
matter what the I. Q., if indicative of constancy of 
development, are at a 45-degree angle. On equally- 
spaced charts uniformity in rate-growth would have to 
GRAPH 48 
Average Growth Curves 
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be represented by different algebraic formule. This has 
an important bearing upon the interpretation of com- 
parative curves. It appears, upon a superficial examina- 
tion of the four curves of Graph 48, that there is 
practically little variation between them, the curves for 
VIII and X being almost exact duplications of the 
curves for III and V. Yet when VIII and X are com- 
pared with III and V in Graph 49, no such striking 
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GRAPH 49 


Mental Age Growth Curves 
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similarity is evident. In Graph 48, curves III and VIII, 
especially between the ages of 8 to 14 are almost parallel. 
The actual differences are brought out more definitely 
in Graph 49, especially for ages 14, 15 and 16. Taking 
the individual curves, it is more evident in Graph 49 that 
age X manifests a regular reduction of I. Q. from age 11 
to 16; that age VIII also manifests a constant regular 
reduction of I. Q. somewhat greater than age X; that 
age V shows a slight increase in rate of growth up to 
132 months (age 11), then there is a rapid regression, 
the ratio of which remains the same up to age 16; and 
that age III manifests only a slight decrease in rate of 
growth up to 108 months (age 9), then follows a sudden 
constant rate of regression up to 168 months (age 14), 
then the reduction takes a rapid increase up to age 16. 

Reference to Fig. 12 (p. 107) of Doll’s monograph 
will emphasize again the need for this suggested method 
for graphing growth curves. In this figure are presented 
the individual growth curves showing early arrest with 
consequent I. Q. decreases. All these curves (Cases 9, 
17, 16, 48, 64, 98, 134, 164) are practically parallel, and 
it was necessary to indicate under each curve the different 
I. Q. values at each life age. The differences of I. Q. 
at the two ends of each curve are here presented: 


Case No. I. Q. RANGE ' DIFFERENCE 
9 26 i 7 12 
17 38-25 13 


Intelligence Quotient 
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On logarithmic cross-section paper these differences 
would have been more apparent. 

Graph 50 illustrates, in another fashion, the advan- 
tages of the ratio graph over the customary method of 
plotting rate progress. Two curves are here presented, 
labeled I and II. The two curves run exactly parallel 


GRAPH 50 
L. Q. Fluctuations 
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in (A), yet in (B), where rate is more adequately repre- 
sented, no such parallel progress is observed. It is a 
matter of common knowledge that at lower ages, because 
of the exaggerated significance of small deviations, there 
is bound to be greater inconstancy. A deviation of 6 
months at age 6 will produce a marked change of I. Q. 
At age 16, however, a fluctuation of that size is 
relatively insignificant. To what extent this condition 
accounts for some of the spurious inconstancies at lower 
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ages is yet to be determined. ‘It is probable that cross- 
section paper reversing the divisions, so that at higher 
ages fluctuations of a given magnitude are granted greater 
weight, and at lower ages, less weight, may equalize the 
inevitable discrepancies. 

One of the important tasks confronting experimental 
psychologists who are investigating the problem of in- 
telligence development is to determine the nature of its 
progress. Do endowments unfold or develop at a uniform 
rate, or are there increments or decrements, regular or 
irregular? To answer this question, perhaps a variety 
of intelligence tests, other than the Binet, may have to 
be utilized. And the statistical interpretation of the 
problem will be greatly facilitated by the use of the 
ratio chart. 


3. A PERFORMANCE INTELLIGENCE SCALE 


The work of the last few years has contributed con- 
siderable material on performance intelligence tests. 
The block designs, it is hoped, will be found to be a 
practicable addition thereto. Although this test may be 
utilized as a measure of intelligence by itself, its greatest 
value, however, may be realized in combination with 
other performance tests which are capable of incorpora- 
tion in such a scale. 

The time is ripe for the development of a performance 
intelligence scale comparable in construction to the 
Binet. An especially rich field for data is the monograph 


1Trving Fisher: “The ‘Ratio’ Chart.” Quarterly Publications 
American Statistical Association, 1917, pp. 577-601. 
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dealing with the results of intelligence tests in the 
army.! 

It was not regarded within the province of this 
piece of research to develop such a scale, the purpose 
being rather to standardize a new set of tests, discussing 
therewith numerous allied questions and problems. 


*R. M. Yerkes: “Psychological Examining in the Army.” 
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GROUPED DISTRIBUTIONS OF ABILITY 


It is the purpose of this section to assist those attempt- 
ing to determine how accurately a test or scheme of tests 
approximates normal probability in its distribution of 
results, when the effort is made to classify the individuals 
measured into three, five, seven, or nine groups. The 
discussion of groupings to determine which leads to most 
satisfactory results will be deferred for later treatment. 


A. Three Groups 

Let us assume that we wish to classify individual dif- 
ferences in mental ability or in any trait or characteristic 
into three groups. What proportion of 100 per cent 
would we expect to find in each group?! 

Let us consider three possibilities, where the limits of 
the distribution-range are 

(a) +30 
(b) 42.50 
(c) +6Q. 

(a) +30. Rangeis6o. 

Since we are dealing with three groups, each will have 
an extent of 6/3 o, or 2 o. Consequently the limits 
for the three groups will be 

First Group, —_.00 to 2.00 
Second Group, 2.01 to 4.00 
Third Group, 4.01 to 6.00 


1 The final figures in this article are obtained from the formula of the 
normal probability curve, 
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From a table! giving the values of x/o we find that the 


first group includes 15.73% of cases, 
first and second groups include 84.27% of cases. 


Therefore: 


1st Group includes 15.73% of cases 
2nd Group includes 68.54% of cases 
3rd Group includes 15.73% of cases 


(b) +256 Range is 5 0 


Since we are dealing with three groups, each will 
have an extent of 5/3 0, or 1.667 o. Consequently the 
limits for the three groups will be 


First Group, _—__.000 to 1.667 
Second Group, 1.668 to 3.333 
Third Group, 3.334 to 5.000 


From the x/o table? we find that the 


first group includes 19.63% of cases, 
first and second groups include 80.37% of cases. 


Therefore: 


1st Group includes 19.63% of cases 
2nd Group includes 60.747 of cases 
3rd Group includes 19.63% of cases 


&1H. O. Rugg, “Statistical Methods Applied to Education,” 1917, 
Table VI, pp. 396-400. 
2 Table V, pp. 392-395, in Rugg. 
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(c) +6Q. Range is 12 Q. 


Since we are dealing with three groups, each will have 
an extent of 12/3 Q, or 4 Q. Consequently the limits for 
the three groups will be 


First Group, 6 Q— 2Q 
Second Group, 2 (2 Q) 
Third Group, 6 Q— 2Q 


From the x/P. E. table (Table IV, p. 391 in Rugg, 
interpolated) the percentage included within each group 
will be 

First Group, 50.00 — 41.13% 
Second Group, 2 (41.13)% 
Third Group, 50.00 — 41.13% 


Therefore: 


1st Group includes 8.87% of cases 
and Group includes 82.267 of cases 
3rd Group includes 8.87% of cases 


B. Five Groups 


Let us assume that we wish to classify individual 
differences in a given trait into five groups. What pro- 
portion of roo per cent would we expect to find in each 
group? Let us again consider three possibilities where 
the limits of the score-range are 


(a2) +30 
(}) +250 
(c) +6Q 


APPENDIX 1 are 


(a) +30 Range is 6 o 
Since we are dealing with five groups, each will have 
an extent of 6/5 o, or 1.2 o. The limits for the five 
groups will be 
First Group, _.00 to 1.20 
Second Group, 1.21 to 2.40 
Third Group, 2.41 to 3.60 
Fourth Group, 3.61 to 4.80 
Fifth Group, 4.81 to 6.00 
From our tables we find that the 
1st group includes 3.45% of cases 
1st and 2nd groups include 27.29% of cases 
ist, 2nd, and 3rd groups include 72.71% of cases 
st, 2nd, 3rd, and 4th groups include 96.55% of 
cases 


Therefore: 
1st Group includes 3.45% of cases 
2nd Group includes 23.84% of cases 
3rd Group includes 45.42% of cases 
4th Group includes 23.84% of cases 
5th Group includes 3.45% of cases 
(6) +250 Range is 5 7 
Extent of each group is 5/5 o, or 1 o. The limits for 
the five groups will be 
First Group, __.00 to 1.00 
Second Group, 1.01 to 2.00 
Third Group, 2.01 to 3.00 
Fourth Group, 3.01 to 4.00 
Fifth Group 4.01 to 5.00 
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From our tables we find that the 


1st group includes 6.06% of cases 

1st and 2nd groups include 30.23% of cases 

1st, 2nd, and 3rd groups include 69.77% of cases 

st, 2nd, 3rd, and 4th groups include 93.94% of 
cases 


Therefore: 
1st Group includes 6.96% of cases 
2nd Group includes 24.17% of cases 
3rd Group includes 39.54% of cases 
4th Group includes 24.17% of cases 
5th Group includes 6.06% of cases 


(c) +6Q Range is 12 Q 


Extent of each group is 12/5 Q, or 2.40Q. The limits 
for the five groups will be 


First Group, 6.00 Q to 3.60 Q 
Second Group, 3.60 Q to 1.20 Q 
Third Group, 2.00 to1.20Q 
Fourth Group, 3.60 Q to 1.20 Q 
Fifth Group, 6.00 Q to 3.60 Q 


From the tables we find that the percentage included 
within each group will be 


First Group, 50.00 to 49.24% 
Second Group 49.24 to 29.08% 
Third Group, 2.00 to 29.08% 
Fourth Group, 49.24 to 29.08% 
Fifth Group, 50.00 to 49.24% 
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Therefore: 7 
1st Group includes 0.76% of cases 
2nd Group includes 20.16% of cases 
3rd Group includes 58.16% of cases 
4th Group includes 20.16% of cases 
5th Group includes 0.76% of cases 


C. Seven Groups 
(a) +30 Range is60 _ 


Extent of each group is 6/7 @, or .857 o. The limits 
for the seven groups are: 


First Group, 000 to .857 
Second Group, .858 to 1.714 
Third Group, 1.715 to 2.571 
Fourth Group, 2.572 to 3.429 
Fifth Group, 3.430 to 4.286 
Sixth Group, 4.287 to 5.143 
Seventh Group, 5.144 to 6.000 


From the x/ga table we find that the 
1st group includes 1.47% of cases 
1st and 2nd groups include 9.78% of cases 
1st, 2nd, and 3rd groups include 33.26% of cases 
ist, 2nd, 3rd, and 4th groups include 66.74% of 
cases 


Therefore: 
1st Group includes 1.47% of cases 
and Group includes 8.31% of cases 
3rd Group includes 23.48% of cases 
4th Group includes 33.48% of cases 
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5th Group includes 23.487 of cases 
6th Group includes 8.31% of cases 
7th Group includes 1.47% of cases 


(6) +2506 Range is 5 o 


The extent of each group is 5/7 o, or .7140. The 
limits for the seven groups are 


First Group, .000 to .714 
Second Group, .715 to 1.429 
Third Group, 1.430 to 2.143 
Fourth Group, 2.144 to 2.857 
Fifth Group, 2.858 to 3.572 
Sixth Group, 3.573 to 4.286 
Seventh Group, 4.287 to 5.000 


From the x/o table we find that the 


ist group includes 3.08% of cases 

1st and 2nd groups include 13.59% of cases 

st, 2nd, and 3rd groups include 35.43% of cases 

ist, 2nd, 3rd, and 4th groups include 64.57% of 
cases 


Therefore: 


1st Group includes 3.08% of cases 
2nd Group includes 10.51% of cases 
grd Group includes 21.84% of cases 
4th Group includes 29.14% of cases 
5th Group includes 21.84% of cases 
6th Group includes 10.51% of cases 
7th Group includes 3.08% of cases 
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(c) +6Q Range is 12 Q 


The extent of each group is 12/7 Q, or 1.71 Q. The 
limits for the seven groups will be 


First Group, 6.00 Q — 4.285 Q 
Second Group, 4.285 Q — 2.571 Q 
Third Group 2.571 Q— .857Q 
Fourth Group, 2 (.857 Q) 

Fifth Group, 2.571 Q— .857Q 
Sixth Group, 4.285 Q — 2.571 Q 
Seventh Group, 6.00 Q — 4.285 Q 


From the tables we find that the percentage included 
within each group will be 
First Group, 50.00 to 49.81% 
Second Group, 49.81 to 45.85% 
Third Group, 45.85 to 21.84% 
Fourth Group, 2 (21.84%) 


Therefore: f 
1st Group includes _.19% of cases 
and Group includes 3.96% of cases 
3rd Group includes 24.01% of cases 
4th Group includes 43.68% of cases 
5th Group includes 24.01% of cases 
6th Group includes 3.96% of cases 
7th Group includes .19% of cases 


It is recommended that wherever possible larger group 
differentations be utilized in educational and psycholog- 
ical investigations. This practice not alone yields more 
intelligible material but is of superior service in correla- 
tional analyses. 
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D. Nine Groups 

(a) 4306 Range is 6¢ 

Extent of each group is 6/9 o, or .667 o. The limits 
for the nine groups are 


First Group, .000 to .667 
Second Group,  .668 to 1.333 
Third Group, 1.334 to 2.000 
Fourth Group, 2.001 to 2.667 
Fifth Group, 2.668 to 3.333 
Sixth Group, 3.334 to 4.000 
Seventh Group, 4.001 to 4.667 
Eighth Group, 4.668 to 5.333 
Ninth Group, 5.334 to 6.000 


From the x/c table we find that the 


ist group includes .84% of cases 

ist and 2nd groups include 4.64% of cases 

st, 2nd, and 3rd groups include 15.73% of cases - 
1st, 2nd, 3rd, and 4th groups include 36.82% 

tst, 2nd, 3rd, 4th, and sth groups include 63.18% 


Therefore: 
tst Group includes 84% of cases 
2nd Group includes 3.80% of cases 
3rd Group includes 11.09% of cases 
4th Group includes 21.09% of cases 
5th Group includes 26.36% of cases 
6th Group includes 21.09% of cases 
7th Group includes 11.09% of cases 
8th Group includes 3.80% of cases 
oth Group includes .84% of cases 
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(6) +2.5¢ Range is’5 « 


The extent of each group is 5/90, or .556c. The 
limits for the nine groups are 


First Group, .000 to .556 
Second Group, .557 to 1.111 
Third Group, 1.112 to 1.667 
Fourth Group, 1.668 to 2.222 
Fifth Group, 2.223 to 2.778. 
Sixth Group, 2.779 to 3.333 
Seventh Group, 3.334 to 3.889 
Eighth Group, 3.890 to 4.444 
Ninth Group, 4.445 to 5.000 


From the x/o table we find that the 
1st group includes 1.98% of cases 
1st and 2nd groups include 7.63% of cases 
st, 2nd, and 3rd groups include 19.63% of cases 
1st, 2nd, 3rd, and 4th groups include 38.43% of cases 
1st, 2nd, 3rd, 4th, and 5th groups include 61.57% of 
cases 


Therefore: 
tst Group includes 1.98% of cases 
2nd Group includes 5.65% of cases 
3rd Group includes 12.00% of cases 
4th Group includes 18.80% of cases 
5th Group includes 23.14% of cases 
6th Group includes 18.807 of cases 
7th Group includes 12.00% of cases 
8th Group includes 5.65% of cases 
oth Group includes 1.98% of cases 
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(c) +6Q Range is 12 Q 


The extent of each group is 12/9 Q, or 1.33 Q. The 
limits for the nine groups will be 


First Group, 6.00 Q — 4.667 Q 
Second Group, 4.667 Q — 3.333 Q 
Third Group, 3.333 Q — 2.000Q 
Fourth Group, 2.000Q— .667Q 
Fifth Group, 2 (.667 Q) 

Sixth Group, 2.0c00Q— .667Q 
Seventh Group, 3.333 Q — 2.000 Q 
Eighth Group, 4.667 Q — 3.333 Q 
Ninth Group, 6.0co Q — 4.667 Q 


From the tables we find that the percentage included 
within each group will be 
First Group, 50.00 to 49.91% 
Second Group, 49.91 to 48.78% 
Third Group, 48.78 to 41.13% 
Fourth Group, 41.13 to 17.36% 
Fifth Group, 2 (17.36%) 


Therefore: 
1st Group includes .09% of cases 
2nd Group includes 1.13% of cases 
3rd Group includes 7.65% of cases 
4th Group includes 23.77% of cases 
5th Group includes 34.72% of cases 
6th Group includes 23.777 of cases 
7th Group includes 7.65% of cases 
8th Group includes 1.13% of cases 
oth Group includes .09Q% of cases 
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In the following tables are’given’ the various per- 
centages for three, five, seven, and nine groups, where 
the ranges are 6, 5, and 12 Q respectively. 


TABLE LXXXV 


RANGE 6¢ 
BELOW Mmpte ABOVE 
Group SS a 2 ee 
4 3 2 I ° b 2 3 


1.47| 8.31 | 23.48 | 33.48 | 23.48 | 8.31 | 1.47 
84 | 3.80 | 11.09 | 21.09 | 26.36 | 21.09 |11.09 | 3.80 


TABLE LXXXVI 


RANGE 5¢ 
BELOW | MUDDLE ABOVE 
Group aa ee TOTAL 
4 3 2 I ° I 2 3 4 
3 19.63 | 60.74 | 19.63 100% 
5 6.06 | 24.17 | 39.54 | 24.17 | 6.06 100% 
7 3.08 | 10.51 | 21.84 | 29.14 | 21.84 |10.51 | 3.08 100% 
9 |1.98| 5.65 | 12.00 | 18.80 | 23.14 | 18.80 |12.00| 5.65 |1.98]] 100% 


TABLE LXXXVII 
RANGE 12Q 


BELOW MmpLe 
Group 
4 3 2 I ° I 
3 8.87 | 82.26] 8.87 
5 0.76 | 20.16 | 58.16 | 20.16 
7 0.19 | 3.96 | 24.01 | 43.68 | 24.01 
9 | 0.09 | 1.13 | 7-65 | 23-77 | 34-72 | 23-77 


The values in the body of the tables are percentages. 
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E. Practical Applications 


1. School Marks: In assigning grades to pupils 
teachers often utilize a five-group classification, the 
range being assumed 5 o. Thus Starch in his “ Educa- 
tional Measurements” states: “On the basis of all these © 
experimental results it would seem that the most satis- 
factory marking system would be a scale of five steps: 


A, or Excellent which should be assigned to approxi- 
mately 7% of the pupils. 

B, or Superior, which should be assigned to approxi- 
mately 24% of the pupils. 

C, or Average, which should be assigned to approxi- 
mately 38% of the pupils. 

D, or Inferior, which should be assigned to approxi- 
mately 24% of the pupils. 

E, or Unsatisfactory, which should be assigned to ap- 
proximately 7% of the pupils.” (P. 15.) 


And Rugg in his ‘‘Statistical Methods Applied to Educa- 
tion” (p. 219) gives the same figures. 

The chief advantages of this system of marking are, 
first, that the theoretical values for each group are 
based upon correct statistical theory; second, the groups 
— superior, average, inferior, etc. — cover equal ranges 
of ability; and third, the personal equation of the ex- 
aminer is greatly reduced, if not entirely eliminated. 

When the score-range or mark-range is 6 o, or 12 Q, 
and should more than a five-group classification be de- 
sired, the tables in this article may be found of value. 

2. Satisfying Economic Demand: In view of the fact 
that physical and mental traits yield distributions 
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closely resembling the normal ‘probability curve, it is 
logical to assume that the satisfaction of needs to which 
these traits are allied would be compelled to conform 
more or less closely to this probability. For example, 
head circumference, length of foot, length of torso, 
length of hand, etc., are traits which yield Gaussian or 
bell-shaped distributions. Therefore, the hatter, the 
shoe manufacturer, the shirt manufacturer, the glover, 
and so on, must take account of grouped variability. 
If the hatter is going to manufacture nine sizes of hats 
and if head circumference is found distributed over a 
range of 6c, then having chosen equal units of differ- 
ence between hat sizes, the per cent of each size must be 
as follows: (from smallest to largest size), 1, 4, 11, 21, 26, 
Oi, It; 4; 2. 

3. Testing Tests: In standardizing tests or scales, it 
is desirable to determine how closely one’s results con- 
form to the normal frequency. Where one’s score-range 
is 6 ¢, or 5a, or 12 Q, the tables in this article readily 
lend themselves for such comparisons. Should the 
score-range be different, then a new table of values has 
to be derived, utilizing the same method as we have 
followed above. Thus, in Terman’s ‘The Stanford Re- 
vision and Extension of the Binet-Simon Scale for Meas- 
uring Intelligence” we note a comparison of nine groupsof 
obtained intelligence quotients with the percentage one 
would theoretically expect to find. The range of in- 
telligence quotients is from 56 to 145, or about 8Q. 
The obtained percentages for the nine groups are: .33, 
2.3, 8.6, 20.1, 33-9, 23-1, 9-, 2-3, -55 (Pp. 42). The theoreti- 
cal values are: .16, 1.6, 8.5, 23.42, 32.64, 23.42, 8.5, 1.6, 
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.16. The correspondence is remarkably close and is a 
strong argument in favor of the validity of the intelli- 
gence quotient, as well as of the Stanford Revision of the 
Binet scale. 

With the application of statistical methods to psycho- 
logical, educational, and industrial problems becoming 
more common, we may expect a wider and wider use of 
grouped variability. 
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New Correlation Method 


In his “Mental and Social Measurements”? (2nd 
edition) (pp. 172-177) Thorndike points out that the 
formula for 7 stated as follows, 


gd a) (x) 
Vix VTy2’ 


is a simpler form of the Pearson coefficient of correlation 
known as 
Z(a-y) } (2) 


NO .0R 


In Table 42, facing p. 176, Thorndike presents the 
method for determining r by formula (1). 

The writer has had frequent occasion to observe that 
because of the elimination of the frequency interval 
which contains the median, together with the number 
of cases therein found, the normal balance of the cor- 
relation is seriously disturbed. Thus, correlation tables 
are met with in which the frequency is skewed and the 
median barely falls into the interval containing it. In 
spite of this condition, the entire interval is disregarded 
in the calculations for 7. Some very weird coefficients 
inevitably result, differing considerably from r as would 


have been determined bv means of formula (2). 
289 
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It was to correct this occasional inaccuracy that the 
following method has been used throughout this mono- 
graph. 

Table LXXXVIII presents the procedure commonly 
practiced. Table LXXXIX illustrates the suggested 
method of determining the value of r. Scientific accu- 
racy is increased without increase of labor. 

It will be observed that the number of cases is 57, the 
median case being the 29th. For ability in A, the median 
just barely falls into the fourth frequency interval. For 
ability in B, the median falls well into the fourth fre- 
quency interval. Table LXXXIX takes this difference 
into account in the following manner: For the x variable 
the median falls upon the first case in 17. If this group 
is divided into four sections each section will contain 4144 
cases. The general rule is, when the median case fall 
in the first fourth section divide your table into two 
segments, the dividing line being drawn to the left of 
the frequency interval; when the median case falls 
within the second or third fourths (the middle half), 
then only, should the whole frequency be eliminated. 
In that event lines are drawn both to the right and left 
of the interval. If, however, the median falls in the last 
fourth, the table is again divided into only two segments, 
the dividing line being drawn to the right of the fre- 
quency interval. This procedure is illustrated in Table 
LXXXIX, the median for ability in A falling in the first 
quarter of 17, and the median for ability in B falling in 
the middle half of the frequency 12. 

The mathematical proof has been supplied by Dr. J. 
E. Coover and follows the tables. 
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TABLE LXXXVIII 
CoRRELATION METHOD CommMonty USED 


Ability in A 


291 


Ability in B 


I 2 3 4 5 6 7 ToraL 
6 I 2 2 I 6 
7 5 qT Tt I 8 2 
8 &} 5 2 e TO ur 
9 | : crn EE £5) EEG 
Io I I 5 2 Gia 
II 4 3 rT See 
12 I 2 I Aes 
Total 5 Sener 17 8 3 I 57 4 
2 3 i ee ° I 2 y 
z x zy + Zxy — [xy 
23°12 = 23 19-1? = 19 300 72 2 3 
I1-27= 44 I6-27= 64 GF <6 I 
6-37= 54 #10°37= go 4 4 Total= 6 
Total=12t Total =173 012 
6 9 Z«ey = 86 
2 
ee oe 
Total = 92 
86 86 


Lm /121°/173 mee 3302 


86 
145.2 


aa + .59 
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TABLE LXXXIX 
CoRRELATION METHOD USED IN THIS MONOGRAPH 
Ability in A 


32-12 = 32 I9g'?= 19 50° hs 
16°37 = 144 16°22= 64 9 «68 Twig? 
8-52= 200 10°37= go Os 2 
1:7?= 49 Total=173 9 <6 9 
Total = 425 6 18 Total = 23 
2 50 
Sse 
21 
Total = 188 2 xy = 165 
[Eee NORIO. as SOS ae 
© /425-4/173-20-6°13.2 277.9 
=+.61 
Using Pearson’s longer formula (Formula 2) 
ao 82.45 _ 82.45 
57 X 1.36 X 1.74 134.88 
= + .61 


Nore: Utilizing the method suggested by Thorndike (Table 42, in 
reference above-mentioned), r for Table LVI, p. 145, is + .73; by this 
method ¢ is reduced to + .71 
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The Pearson-Bravais formula for the coefficient of 
correlation 


may be converted into the formula 
topes 2D xy 
ViIwx Dy 


in both of which, 


x = the deviations from the mean of the x's, 
and y = the deviations from the mean of the y’s. 


Hl 


When the deviations are calculated from an arbitrary 
origin in order to keep them integral and facilitate cal- 
culation, it is customary to make corrections as shown in 
the formula 


gid, 


in which x’ and y’ are deviations from an arbitrary origin 

and og’ is the Standard Deviation in terms of the class 
/ 

units; 7;, = ae = the correction for the mean. 

When the number of cases is small, and the correction 
is deemed negligible, the following formula has frequently 
been used: 

eee Bais 
Vet Dy 
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and the cases falling in the classes from which x’ and y’ 
have their origin are disregarded and have no influence on 
the calculation of the coefficient. If the means of x and y 
chance to fall midway in the classes chosen for the origin 
of their deviations, no correction would be necessary, 
and the coefficient would be the same as when calculated 
by the longer complete formula. For this reason the 
median class is usually chosen for the origin of deviations. 
If, however, either or both means chance to fall near the 
class-limit, the error may be appreciable. 

Hence, the same formula has been used in such a way 
as to place the origin of deviations at either the mid-point 
of the median class or one of its class-limits, according 
to which lies nearest to the median value in the distribu- 
tion. This modification decreases the possible difference 
between the mean and the origin of deviations from 
14 to 4 of a class-unit, and when the origin of deviations 
falls nearest a class-limit increases the proportion of the 
cases in the table that are utilized in the calculation of 
the coefficient. 

When the origin of the deviations is placed at a class- 
limit, the class deviations run as follows: .5, 1.5, 2.5, etc.; 
decimals are eliminated by multiplying by 2; as, 1, 3, 5, 
7, etc. Correction for this change in the class-deviations 
is automatic in the formula: 

(1) Suppose origins for x’ and y’ both fall at class- 
limits, and a double-prime designates the class-deviations 
that are multiplied by 2. 

Then 
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>> aly! ; , 
and ots iad Ss nee ee ’. 
Ve a Zyl VEaX Dy 
4 4 


(2) Suppose only the origin of x’ falls on a class-limit: 


13 eel A Ilo 
Then Sys Bat = 25S 
> aly! . 
2 2D x'y’ 
and TiS One a = VSq2- 3 y2 =f 
/ x > y’2 y 
4 


The amount of error involved in the use of the formula 
may be tested without recalculating by the following 
correction: 


(a) For the numerator: 
Pot es 
n 


(6) For the denominator: 


APPENDIX III 
Elaboration of Sheppard’s Table 


In order to add to the convenience of those utilizing 
tables of values of the normal probability integral, 
Sheppard’s Table for Q (or P. E.), presented as Table 
45 (p. 200) in Thorndike’s ‘‘ Mental and Social Measure- 
ments” (2d edition), and as Table XLVII (p. 116) in 
Buckingham’s “Spelling Ability,’ has been elaborated, 
giving the straight-line interpolations to one-hundredths 
P. E. in Table XC following: 
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Typical Block-Design Records 


The following records will illustrate the nature of the 
record blank used in the original standardization of the 
tests. Twenty designs were utilized, from which seven- 
teen have been selected in the final revision of the test. 
This type of record sheet lends itself to a convenient 
notation of errors in performance and to recording brief 
notes to assist in the interpretation of the results. 
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NO. 26 Examined-Nov. 15, 1917-2:15 P. M. 
2nd Grade 
Life Age - 7y. 6m. 


Wilbur C---N 
1 Binet Age-8y. Om. 
16’-4 
es 
2 Time 
Limit-11 Seems lost- 
— still hunting 
for the right 
block 
3 Time 
Limit-15 Nothing done 
= still trying 
2 blocks - 
Placing flat - on side- ver. & hor. 
4 Limit-13 
- B® @ B] 
BI 
5 Limit -12 
Power of 
= sic! analysis 
seems 
lacking 


BLOCK-DESIGN SCORE 
=3 
B.D. MENTAL AGE =6 Y.3 M. 
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NO. 263 Examined-Ap. 24, 1918-10 A. M. 


3-4 Grade 
Albert R---S Life Age - 10y. 4m. 
1 21°-7 11 Limit - 29 
+ =A Binet Age- 
B 
lly.4m. 
2 1/19%e12 12. Limit - 34 
(5’0”-36; not yet O.K.) 
+ — Had O. K. once, then 
destroyed 
3 44”-9 13 Limit - 31 


te BLOCK-DESIGN| — [RRR 
SCORE =46 
B.D.M.A.= 
4 1/5"-11 ]11Y.10M. | 14 3/54"-41 
+ —- 
5 49"-11 15 Limit - 29 
+ - BC 
7 
6 33°-10 16 Limit - 49 
(413-52; O. K.) 
+ ay 
(+) 
7 2/17"-30 17 2/48”-30 
Go = 
8 Limit-21 
ag 4 
9 2/8".20 19 Limit-48 (S: “The 


S \| Ficture is 
+ — |A7RR \| 80 small & 
NE there are 


so many blocks, - It gits 
10 1/58"-18 20 Limit - 42 youstuck”) 
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NO. 176 Examined-Ap..2, 1918-9 A.M. 
4B Grade 
Life Age = 9y. 2m. 
James B---H 
1 22°-8 Binet Age-8Y. 10M. 


+ NOTE: 
Has set something 
like these at home. 


2 327-4 Larger size, but not 
same colors. 

es 

3 467-10 

ae 

ae 

chleetacs BLOCK-DESIGN SCORE =16 
a B.D. MENTAL AGE =8 Y. 9 M. 
5 1°34"-15 

aE 

6 Limit-16 

7 Limit - 30 

S: “I don’t see how 
a you get these yellow 
“ones on the side here.” 
8 Limit - 20 
Later+ 
ze LW] R] 
ee RW] 
xy 
9 Limit -16 
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Abbreviated Army Performance 
Test, 157 
Ability, grouped distributions of, 
273 {. 
native, 248 
“spread” of, 193 
Absolute standard, 180 
Abstraction, 13 
Acceleration, 49 f. 
Adaptation, 11, 32, 168f., 174, 
238 f. 
Adaptive difficulties, 238 
Adolescence, 13,20 
Adulthood, 13 
Adults, mental age of, 237 f. 
Age-grade distribution, 39 f. 
Age-progress analysis, 39 f. 
Age standardization, 104 f. 
Ambition, 258 
Analogies, 16 
Analysis, 6f., 12f., 20f., 26f., 
170 f. 
defined, 7 
Analyst, 20 
Analytic activity, 12f., 18, 171, 
175 
tendency, 19 
type, 21 
Analytic-synthetic power, 28, 126 
Analyzing ability, 23 
Anatomists, 28 
Animal discrimination, 30 
learning, 23 
psychology, 21 
Animals, 22, 24 f. 
Anti-social classes, 257 
Aphasias, 26 
Application, 258 
Arithmetic, 63, 89 f., 190 f. 
Army Alpha (see Militar ‘y Test), 
157, 246 


Army Beta, 15 

tests (see Military Tests), 138, 

238 f. 

Assimilating, 18 
Assimilation, 7, rr f. 
Assimilative type, 21 
Associated Charities, 221 
Association, 23 f., 173 

of ideas, 4, 11 f. 
Associationist school, 3 
Attention, 22 f., 174 
Auto-criticism, 174 
Average man, 85 


Behavior habit, 23 
Behaviorist, 9 
Bias, 144 
Binet scale, 16, 41 f., 68, 78 £., 157, 
168, 205 f. 
accuracy, 118 
Birthplace, 39 f., 58 
Blending, 7, 12 
Block design records, 300 f. 
test, 39 f. 
Blocks, 64 f. 
Borderzone case, 187, 210 f., 235 
Boys’ and Girls’ Aid Society, 220 
Buckingham spelling test, 72 
Business men, 198 


Chance, 85 f. 
Childhood, 13 
Chinese, 158 
Choice, 22 
Chronological age, 25 
norms, 121 f. 
Clinical differentiation, 210 f. 
psychology, 210 f. 
Combination, 12 
Combinative ability, 7, 10, 26, 
169 f. 
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Combining, 175 
“Common-sense check, 187 

test of, 257 
Comparing, 171, 175 
Comparison, 7, 12 f. 
Completing, 175 
Completion, ro, 12 
Composite norms, 112 f. 
Concepts, 4, 14 
Conceptual thinking, 15 
Conduct evaluation, 219 
Conscientiousness, 258 
Consciousness, 7 f. 

of end, 175 
Consistency, 156, 204 f. 
Construction Test A and B, 157 
Constructive activity, 12 
Convict, the English, 251 
Correlation, 10, 68, 143 f., 180 f. 

comparisons, 157 f. 

formulae, 100 

method revised, 289 f. 
Correlational analysis, 281 
Cortex integrity, 31 
Cortical ablations, 31 
Cosmic hypothesis, 171 
Crime causes, 252 f. 
Criminal diathesis, 255 

habitual, 252 

type, 250 


Critical ninths, method of, 228 f. 


Criticising, 175 

Crowd psychology, 247 
Cube Construction Test, 157 
Cube Imitation Test, 157 


Deaf, 235 
Deciding, 175 
Deduction, 12 
Defective intelligence, 252 
Defectiveness, 169 
Definitions of moral terms, 219 
Deliberating, 175 
Delinquency, 169, 198 
Delinquents, children, 257 
potential, 256 
women, 251, 253 
Deportment, 63 
Design eliminations, 161 f. 
Designs, 65 f. 


Desire, 22 
Diagnostic accuracy, 179 
criteria, 142, 176 f. 
efficiency, 164, 200, 233 f. 
syllabus, 211 
tools, 143 
Differential psychology, 80 
Differentiation, 7, 12 
Digit-Symbol Test, 157 
Direct comparison, method of, 
224 f. 
Disarranged sentences, 247 
Discrimination, 7, 12f., 17, 22f., 
__ 17%; 175 
Discriminative type, 21 
Dissociation, 25 
Drawing, 18, 26, 63, 190 f. 


Economic demand, 273 f., 286 
Education, 26, 169 
Educational statisticians, 100 
statistics, 78 
treatment, 177 
Electronic theory, 171 
Emotion, 8 
Endocrines, 236 
Endowment 158, 190, 264 f. 
Epistemology, 5 
Equal units scale, 84 f. 
Ethical Discrimination Test, 214 f. 
Etna School, 222 
Evolution, doctrine of, 171 
Experience, 169 
Experimentation, 17 


Faculties, 27 

Faculty psychology, 173 

Fatigue, 22 

Fear, 22 

Feeble-minded, 19, 28, 173, 176, 
179, 181f., 185, 196, 199, 


208 f. 
Feeble-mindedness defined, 209, 
235 f. 
Ferguson Form Boards, 157 
Final norms, 166 f. 
test revision, 161 f. 
Foot, length of, 287 
Foreign born, 51, 158 
Form Board ability, 157 
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Form Board test, 157 
“Fountain of Youth,” 187 
Functional efficiency, 182 
Functionalist, 9 

Fusion, 7, 11 f. 


Gaussian curve, 287 

Generalizing abstraction, 24 

Genetic psychology, 21, 25 

Genius, 17 

Geography, 26, 63 

Germinal determiners, 22 

Glover, 287 

Graphic functions, 18 

Graphic presentation of norms, 
126i 

Grip, 92 f. 

Group differentiation, 151 

Group testing, 137 f., 195 

vs. individual testing, 247 

Grouped measures of variability, 

58, 287 f. 


Habit, 8, 22 

Haggerty Intelligence Examina- 
tion, 137 f. 

Hand length, 287 

“Hand” subjects, 191 

Hatter, 287 

Head circumference, 287 

Height, 81 f., 88, 175 

Heredity, theory of, 171 

Hierarchies of mental functioning, 
5 f., 10, 19, 29, 170 

Higher animals, 22 

Higher thought. 8 

History, 63 

Hoboes, 198 

Home conditions, 39 f., 58 f. 

Household arts, 63, 190 f. 

Human traits, 80 f. 


Ideas, 8 

Tdeation, 170 

Ideational activity, 15 

Idiots, 244 f. 

Illinois Examination, 214 f., 246 
Illinois Prison Survey, 250 
Tlliterates, 76 f. 

Imagery, 26 
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Images, 8, 26 
Imagination, 4, 173 
Imaginative-synthetic period, 20 
Imbeciles, 244 f. 
Indiana Survey Tests, 158 
Individual differences, 16 f., 80, 84, 
169, 182 
Induction, 12 
Industrial applications, 169 
education, 254 
problems, 288 
Inferior endowment, 158 
Information, 169 
Innate ideas, 4 
Instincts, 248 
Integration, 7 f., 11, 29 f. 
Integrative function, nervous sys- 
tem, 29 
Intellectual behavior, 172 
Intelligence, 10, 16, 22, 24, 28, 32, 


168 f. 
defined, 168 f. 
distribution, 89, 193 
maturity, 258 
of women, 261 
quotient, 176 f. 
constancy, 266 f. 
reduction, 269 
ratios, 179 
Interest, 258 
Interpolation, 94 
Inter-test correlations, 158 
Introspection, 7, 8 
Introspective evidence, 166, 172 
Invention, 171 
Inventors, 16 
Italians, 158 


Japanese, 158 
Judging, 175 
Judgment, 4, 8, r70f., 173 


Knowledge, 6 - 
“Kombinationsfihigkett,”’ 170 
“ Kombinationsgabe,” 168 

“ Kombinations-methode,” 103 


Language, 63, 190 f. 
expression, 192, 201 
factor, 180, 191, 195, 202, 235 
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Language, handicapped, 158, 235 
symbols, 191 
vs. performance, 192 f., 234 f. 
Learning, 8, 23 
Life ages, 39 f. 
Linear projection method, 98 f. 
Linguistic facility, 179 
Logarithmic graphs, 268 f. 
Loquacious “types,” 199 
Lower organisms, 30 


Malaise, 257 
Manikin and Feature Profile Test, 


157 
Manipulation, 175 
Manual training, 63, 190 f. 
Mare and Foal Test, 157 
Mayfield children, 39 f. 
Maze Test, 157 
Meanings, ‘ret., 25 
Measuring rods, 172 
Mechanical ingenuity, 126 
Memory, 4, 11, 22, 26, 173 
Menlo Park children, 39 f. 
Mental ability, 10 
age equivalents, 73 
norms, tos f. 
of adults, 237 f. 
ages, 41 f. 
true, 179 
capacities, 78 
correlation, 22 
deficiency (see feebleminded),209 
development, 7, 262 f. 
rate of, 266 f. 
diagnosis, 179 f. 
dynamics, 5 
endowment, 9, 25 
evolution, 22 
“functions,” 173, 204 
growth, 175 
curves, 267 f. 
tate changes, 262 f. 
hierarchies, 5 f., 10, 19, 29, 170 
initiative, 11 
power, 258 
synthesis, 19 } 
traits, 87 
increasing divergence of, 264 . 
parallel progress of, 264 f. 
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Mental’traits, types, 20 
Metameric nervous system, 29 
Metazoa, 28 
Method of, Be 81 f. 
scoring 
Miltary y Test (see Army Tests), 
3, 195 
“Mind” pisces Igt 
Moral, judgment, 219 
problems, 219 
Moron, 24, 244 f. 
Morons, successful and unsuccess- 
, 246 
Multicellular organisms, 28 
Music, 63 


National Intelligence Tests, 241, 
246 
Nationality, 39 f., 54, 58 
Nature study, 63 
Nerve cell properties, 29 
Nervous, protoplasm, 27 
system, 10, 28 f. 


tissue, 13 
Neurologists, 28 
Neuron, 30 
New York, Prison Commission, 
254 


Prison Survey, 251 

Norm, discrepancies, 121 
setting, 137 

Normal, curve fetish, 100 
distribution curve, 209, 263 f. 
probability, 173 f., 193 f. 
probability curve, 85 f., or f., 99, 

258 f. 
Norms, 54, 71 f. 


Obedience, 258 
Offenders, repeated, 256 
Ogive, 8 f. 

Original tendencies, 65 
Otis Tests, 158 
Over-refining, 100, 139 


Pain, 22 

Palo Alto children, 30 f. 
Pantomime, 75 

Parole measures, 254 
Patience Test, 174 
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Pearson-Bravais formula, 292 
Pedagogical, implications, 25 
progress, 78 
Penitentiary prisoners, 250 
Percentile, method, 80 f. 
technique, 92 f. 
Perception, 8, 11 f., 22,25, 170, 173 
Performance, ror, 234 f. 
intelligence scale, 271 
test, 179 
vs. language, 192 f., 234 f. 
Periodic Law, 171 
Personal opinion, 197 
ey ralty, 258 
, scale method, go f. 
Bei eediaation, 130 f. 
Physical traits, 87 
Physiological set, 25 
Picture, Arrangement Test, 157 
Completion Test, 157 
Pintner’s Non-Language Group- 
Test, 158 
Pleasure, 22 
Poets, 16 
Point scale method, 98 f. 
Porteus Maze Tests, 157 
Portuguese, 158 
Power vs. speed tests, 244 f. 
Practical geniuses, 16 
Pragmatic test, 101, 249 
Predicting school progress, 242 
Pressey Tests, 158 
Prison population, 251 
Prisoners, 198 
vs. men generally, 250 f. 
Probability, 85 f. 
Probable error, 173, 204 f. 
Problem solution, 168 
Prognostic diagnoses, 177 
Progressive score reduction, theory 
of, 239 f. 
Protoplasm, 29 
Protozoa, 22, 28 
Proverbs, 219 
Psychical centers, 27 
Psycho-clinician, 177, 211 
Psychological, profile, 80 
criterion, 246 f. 
Psychology, defined, 8 
Public Welfare Bureau, 222 
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Qualitative differences, 81 
Quantitative differences, 8r 
Quartile deviation, 94 
Questionnaire, 39 f., 61 f. 


Race differences, 6, 54, 235 
Rapport, 257 
Ratio chart, 271 
Reading, 63, 190 f. 

ability, 241 f. 

quotients, 193 
Reasoning, 5, 8, 170, 173 
Record sheet, 300 f. 
“Reducing” factors, 239 
Reflex, 8 
Reformatory prisoners, .251 
Reproducing Designs Test, 157 
Retardation, 4o f. 
Rising eer, 175 
Rivalry, 248 


Sampling, 121, 126, 248 f. 
Scale making, 78 f. 
Scattering, 156, 163 
School, marks, 188, 273 f. 
range of, 286 f. 
progress, 56 f. 
standing, 190 f. 
training, 189 
Schooling, 10 
Science, 63 
Scientific men, 16, 171 
Score, card, 69 f. 
values, 73 
inconsistent, 182 
variability, 198 
Scribbling, 18 
Seguin Form Board, 157 
Selecting, 18 
Self-criticism, 18 
Self-government, 254 
Senescence, 13 
Sensation, 8, 173 
Sensations, nature of, 4 f. 
Sense organs, 2 
Sensory capacities, 27 
Serviceability, 235 f. 
Sex differences, 39 f., 118 f., 125 f., 
147, 150 f., 165 . , 190 f. 
explanation, 120, 166 
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Sheppard’s Tables, 130 
elaboration, 296 f. 
Ship Test, 157 
Shirt manufacturer, 287 
Shoe manufacturer, 287 
Silent, areas, 31 
“ type,” 199 
Similarity, 24 
Sing Sing prisoners, 253 
Social, class, 39 f., 58 f 
relations, 219 
treatment, 177 
worker, 212 f. 
Sonoma State Home, 41 f., 181 
Specialized capacities, 195, 204 
Speed vs. power tests, 244 f. 
Spelling, 63, 99 _ 
Standard deviation, 94 
Standardization, 54, 64, 102 f. 
bias, 112 
technique, 78 f., 135 
technique vs. number, 54 
Stanford-Binet Test, 157 
Statistical fallacies, 80 each bg 
Structuralist, 8 
Superior endowment, 158 
Supplementary information, 179 
Syllogistic reasoning, 169 
Symbols, 25 


Synthesis, 5 f:, 9, r2f., 18 f., 22f., 


29, 32, 170f. 
efined, 7 
Synthesist, 20 
Synthesizing ability, 10, 168 
Synthetic activity, 13 
incapacity, 18 


type, 21 
Synthetic-analytic incapacity, 25 
tendency, 12, 25 


Teachers’ estimates, 39 f., 58 f. 
judgments, 187 
Temperament, 258 
Terminal nuclei, 31 
Test, compensation, 179 
correspondence, 184 
criteria, 79 
material, 64 f. 
penalties, 155 
scores, range of, 286 f. 


Test, weighting, 138 f. 
Testing psychological tests, 273 f., 
287 f. 
Tests, directions, 74 f. 
Thalamus, 31 
Thinkers, 171 
Thinking, rz 
Thought, 4, 24 
Thurstone Tests, 158 
Time, 68 f. 
and move norms, 142 f. 
and moves, 99 f. 
limits, 69 
Torso, length of, 287 
Tossing pennies, 85 f. 
Trabue language tests, 41f., 68, 
72, 99, 173, 195 £. 
Transmutation tables, roo 
Trial and error, 23 
True-false test, 247 
True mental age, 179 
Types, 13, 20 f. 


Unsocial classes, 257 


Validity, 172 f. 

Variability, 175f., 201, 
263 f., 287 f. 

Verbal expression, 182 

Verbalistic tests, 234 f. 

Vineland Training School, 41 f., 181 

Vocabulary, 173, 195 f. 

Vorticella, 28 


204 f. 


Wage incentives, 254 
Weight, 175 
Weighting moves, roo f. 

time, roo f. 
Will, 8 
Woman’s Protective Division, 217 
Women, intelligence of, 261 
Woody Arithmetic Test, 73, 99 
Work capacity, 182 
Writing, 63 
Year scale, 127 f. 

method, 78 f. 
Yerkes-Bridges Point Scale, 84 


Zero points, 84 
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